WO2020246935A1 - A portable electronic camera system, a portable electronic camera device and method for obtaining a digital image - Google Patents

A portable electronic camera system, a portable electronic camera device and method for obtaining a digital image Download PDF

Info

Publication number
WO2020246935A1
WO2020246935A1 PCT/SE2020/050562 SE2020050562W WO2020246935A1 WO 2020246935 A1 WO2020246935 A1 WO 2020246935A1 SE 2020050562 W SE2020050562 W SE 2020050562W WO 2020246935 A1 WO2020246935 A1 WO 2020246935A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
interest
area
obtaining
digital
Prior art date
Application number
PCT/SE2020/050562
Other languages
French (fr)
Inventor
Anton Falk
Tobias LINDBÄCK
Anni LEHMUSKERO
Original Assignee
Profoto Aktiebolag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Profoto Aktiebolag filed Critical Profoto Aktiebolag
Publication of WO2020246935A1 publication Critical patent/WO2020246935A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G03B15/02—Illuminating scene
    • G03B15/03—Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05—Combinations of cameras with electronic flash apparatus; Electronic flash units
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
    • G03B7/091—Digital circuits
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/16—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly in accordance with both the intensity of the flash source and the distance of the flash source from the object, e.g. in accordance with the "guide number" of the flash bulb and the focusing of the camera
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/16—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly in accordance with both the intensity of the flash source and the distance of the flash source from the object, e.g. in accordance with the "guide number" of the flash bulb and the focusing of the camera
    • G03B7/17—Selection of modes in flash units by exposure control arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10152—Varying illumination
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Definitions

  • the present disclosure relates to a portable electronic camera device configured to obtain a digital image.
  • DSLR digital single-lens reflex
  • the flash When capturing flash photos with a smartphone one of the problems is that the flash usually is small and is capable of emitting only a limited amount of light. To be able to achieve a noticeable effect from the flash, the ambient light need to be small in comparison.
  • One object of the invention is to facilitate and/or improve the capture of digital composite images for the user.
  • the portable electronic camera system comprises an illumination device arranged to illuminate at least part of a scene with a flash, and an electronic camera device comprising a control element, and a digital camera arranged to capture an image of the scene.
  • the control element is arranged to communicate with the illumination device.
  • the control element is arranged to control the digital camera and the illumination device.
  • the control element is arranged to control the digital camera and the illumination device to obtain a first pre image relating to the scene illuminated by ambient light and a flash of a first intensity; control the digital camera and the illumination device to obtain a second pre image relating to the scene illuminated by ambient light and a flash of a second intensity; obtain user information relating to calculation of a digital composite image, identify at least a first area of interest in the first pre-image and the second pre image, and obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre image and the obtained second pre-image.
  • Obtaining the user information comprises obtaining for each area of interest at least one amplification factor, and calculating the digital composite image comprises amplifying the first pre-image and amplifying the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
  • Scene refers to the field of view of the digital camera, as in the part of the world that is visible through the digital camera.
  • Ambient light refers to the light from all sources except the flash of light from the
  • the first or second intensity may be of zero flash intensity, as in no flash being used.
  • the flash of first intensity has zero intensity, i.e., no flash is used for the first pre-image.
  • the portable electronic camera system comprises at least two illumination devices.
  • the illumination device may comprise communication means arranged to communicate with the control element of the electronic camera device.
  • the illumination device may comprise at least one artificial lighting light source arranged to generate a flash of light.
  • the illumination device may comprise a processor arranged to control the communication means and the at least one artificial lighting light source.
  • the aim of calculating the digital composite image may be to create an image with properties matching the at least one desired property. Thereby the digital composite image may be automatically calculated based on user preferences.
  • the portable electronic camera system also allows users with limited experience of digital camera settings and/or illumination device settings to successfully operate the portable electronic camera system.
  • the invention also allows for calculating the digital composite image with at least one desired user defined property, such as relative luminous exposure, exposure value or white balance.
  • the portable electronic camera system allows for calculating the digital composite image with a user defined relationships between the luminous exposure from the scene with and without a flash without manual changes to digital camera settings and/or illumination device settings.
  • the portable electronic camera system allows for calculating the digital composite image with a user defined exposure value without manual changes to digital camera settings and/or illumination device settings.
  • the above portable electronic camera system allows for calculating the digital composite image with a user defined white balance without manual changes to digital camera settings and/or illumination device settings.
  • the portable electronic camera system may comprise a user interface arranged to receive at least part of the user information.
  • the user information relating to at least one desired property may comprise an exposure value and/or a chromaticity and/or a relation between luminous exposure with and without a flash.
  • the control element may be arranged to control the digital camera and/or the illumination device to obtain the first and/or the second pre-image, wherein pre-image camera settings and/or pre-image illumination device settings are determined and set.
  • the control element may be arranged to set pre-image camera settings and/or pre-image illumination device settings, and control the digital camera and/or illumination device to capture a pre-image.
  • the control element may be arranged to identify at least a first area of interest in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest.
  • the area of interest is identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
  • the user interface may be arranged to receive user information comprising the user selection of at least one area of interest in the first pre-image and the second pre-image.
  • control element is arranged to calculate the digital composite image so as to obtain a desired relation between luminous exposure from the scene with and without a flash in at least one area of interest of said digital composite image.
  • the relation between the luminous exposures correlates the relationship in brightness between objects in the scene illuminated by a flash and objects illuminated significantly less by a flash, such as an object close to and an object far away from the electronic camera device.
  • control element is arranged to calculate the digital composite image so as to obtain a desired exposure value in at least one area of interest of said digital composite image.
  • control element is arranged to calculate the digital composite image so as to obtain a desired white balance in at least one area of interest of said digital composite image.
  • the obtained user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image.
  • Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
  • weighting relates to forming weighted arithmetic means. Unless otherwise specified the weights are normalized, such that weighting two pixel values results in a value within an interval between the two pixels.
  • the weight value for each area of interest of the first and/or second pre-image may be pre set to a default weight value.
  • the use of pre-set weighted values allows the user to only input user information comprising desired deviations from the default weight values.
  • Calculating the digital composite image may further comprise weighting the remaining area of the pre-images, areas not part of any area of interest, with a predetermined weighting value.
  • the digital composite image may be calculated pixel by pixel. In a preferred embodiment, the digital composite image is calculated pixel by pixel.
  • Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
  • Obtaining the user information may comprises obtaining for each area of interest at least one amplification factor.
  • Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre image in each area of interest with the corresponding amplification factor.
  • amplifying relates to multiplication of a value. Amplification may comprise multiplying a value with an amplification factor below one, resulting in a reduced output value. In some examples amplifying an area of interest while calculating a digital composite image may result in values that are higher (or lower) than both the corresponding values for the first pre image and the second pre image. Amplifying as opposed to weighting is typically not limited to values between the input values.
  • Obtaining the user information may comprise obtaining, for each area of interest, a chromaticity adjustment value.
  • Calculating the digital composite image comprises, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
  • the chromaticity adjustment value may be set to zero by default. In a preferred embodiment
  • the default chromaticity adjustment value is set to zero.
  • the electronic camera device may be integrated into an electronic user device, such as a digital camera device, a camera phone, a smartphone or a tablet.
  • Said electronic camera device may be a camera phone, a smartphone or a tablet.
  • the electronic camera device may utilize a camera phone software application configured to control a digital camera and an illumination device, and to calculate the digital composite image.
  • the electronic camera device may comprises a processor.
  • the electronic camera device may comprises a memory storage.
  • the control element may comprise the processor and the memory storage comprising at least one computer program.
  • the computer program is configured to perform at least part of the control, the communication and calculations described in the present disclosure.
  • the present disclosure further relates to a portable electronic camera device for obtaining a digital image
  • the portable electronic camera device comprises a digital camera arranged to capture an image of a scene, and a control element.
  • the control element is arranged to communicate with an illumination device arranged to illuminate at least part of the scene with a flash.
  • the control element is arranged to control the digital camera and the illumination device.
  • the control element is arranged to control the digital camera and the illumination device to obtain a first pre-image relating to the scene illuminated by ambient light and a flash of a first intensity; control the digital camera and the illumination device to obtain a second pre-image relating to the scene illuminated by ambient light and a flash of a second intensity; obtain user information relating to calculation of a digital composite image; and obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre-image and the obtained second pre-image.
  • Scene refers to the field of view of the digital camera, as in the part of the world that is visible through the digital camera.
  • Ambient light refers to the light from all sources except the flash of light from the illumination device.
  • the first or second intensity may be of zero flash intensity, as in no flash being used.
  • the flash of first intensity has zero intensity, i.e., no flash is used for the first pre-image.
  • control element controls the digital camera and the illumination device to obtain a first pre-image with no flash from the illumination device
  • control element controls the illumination device to be turned off, i.e., to not illuminate a flash.
  • control element is arranged to communicate with and control at least two illumination devices.
  • the illumination device may comprise communication means arranged to communicate with the control element of the electronic camera device.
  • the illumination device may comprise at least one artificial lighting light source arranged to generate a flash of light.
  • the illumination device may comprise a processor arranged to control the communication means and the at least one artificial lighting light source.
  • the aim of calculating the digital composite image may be to create an image with properties matching the at least one desired property. Thereby the digital composite image may be automatically calculated based on user preferences.
  • the portable electronic camera device also allows users with limited experience of digital camera settings and/or illumination device settings to successfully operate the portable electronic camera device.
  • the invention also allows for calculating the digital composite image with at least one desired user defined property, such as relative luminous exposure, exposure value or white balance.
  • the portable electronic camera device allows for calculating the digital composite image with a user defined relationships between the luminous exposure from the scene with and without a flash without manual changes to digital camera settings and/or illumination device settings.
  • the portable electronic camera device may comprise a user interface arranged to receive at least part of the user information.
  • the user information relating to at least one desired property may comprise an exposure value and/or a chromaticity and/or a relation between luminous exposure with and without a flash.
  • the control element may be arranged to control the digital camera and/or the illumination device to obtain the first and/or the second pre-image, wherein pre-image camera settings and/or pre-image illumination device settings are determined and set.
  • the control element may be arranged to set pre-image camera settings and/or pre-image illumination device settings, and control the digital camera and/or illumination device to capture a pre-image.
  • the control element may be arranged to identify at least a first area of interest in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest.
  • the area of interest is identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
  • the area of interest relates to the same area in both pre-images. If only one area of interest is identified the digital composite image may only represent the area of the area of interest.
  • Identifying at least a first area of interest may comprise the user actively selecting the first area of interest followed by an automatic computer generated selection of one or more areas of interest.
  • the automatic computer generated selection of one or more areas of interest may select one area of interest comprising the area not included in the first area of interest.
  • Identifying at least a first area of interest may comprise an algorithm identifying features of interest in the first and/or second pre-image, such as facial recognition, wherein identifying at least a first area of interest may be based on said identified features of interest.
  • the user interface may be arranged to receive user information comprising the user selection of at least one area of interest in the first pre-image and the second pre-image.
  • the control element is arranged to calculate the digital composite image so as to obtain a desired relation between luminous exposure from the scene with and without a flash in at least one area of interest of said digital composite image.
  • the relation between the luminous exposures correlates the relationship in brightness between objects in the scene illuminated by a flash and objects illuminated significantly less by a flash, such as an object close to and an object far away from the portable electronic camera device.
  • the obtained user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image.
  • Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
  • Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
  • Obtaining the user information may comprises obtaining for each area of interest at least one amplification factor.
  • Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre image in each area of interest with the corresponding amplification factor.
  • Obtaining the user information may comprise obtaining, for each area of interest, a chromaticity adjustment value.
  • Calculating the digital composite image comprises, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
  • the chromaticity adjustment value may be set to zero by default. In a preferred embodiment
  • the default chromaticity adjustment value is set to zero.
  • Said portable electronic camera device may be integrated into an electronic user device, such as a digital camera device, a camera phone, a smartphone or a tablet.
  • Said portable electronic camera device may be a digital camera device, a camera phone, a smartphone or a tablet.
  • the portable electronic camera device may utilize a camera phone software application configured to control a digital camera and an illumination device, and to calculate the digital composite image.
  • the portable electronic camera device may comprises a processor.
  • the portable electronic camera device may comprises a memory storage.
  • the control element may comprise the processor and the memory storage comprising at least one computer program.
  • the computer program is configured to perform at least part of the control, the communication and calculations described in the present disclosure.
  • the present disclosure further relates to a method for obtaining a digital composite image with a digital camera and an illumination device, the method comprising the steps of obtaining user information, obtaining a first pre-image of a scene by the digital camera illuminated by ambient light and a flash of a first intensity by the illumination device, obtaining a second pre-image of the scene by the digital camera illuminated by ambient light and a flash of a second intensity by the illumination device, and obtaining the digital image by calculating a digital composite image based on the first pre-image and the second pre image.
  • the step of obtaining user information comprises obtaining user information relating to the calculation of the digital composite image. Calculating the digital composite image is based on the user information, the first pre-image and the second pre-image.
  • the method is arranged to obtain a digital composite image with the digital camera and at least two illumination devices.
  • the digital camera and the illumination device are comprised in a portable electronic camera device.
  • the illumination device is an external illumination device in one embodiment.
  • the first or second intensity may be of zero flash intensity, as in no flash being used.
  • the flash of first intensity has zero intensity.
  • the method for obtaining a digital composite image may comprise the step of identifying at least a first area of interest in the first pre-image and the second pre-image.
  • the step of obtaining the digital image by calculating the digital composite image is based also on the identified area of interest.
  • the area of interest may be identified as being the entire first pre image and second pre-image, based on the user information, or identified by an automatic identification process.
  • the area of interest relates to the same area in both pre-images. If only one area of interest is identified the digital composite image may only represent the area of the area of interest.
  • Identifying at least a first area of interest may comprise the user actively selecting the first area of interest followed by an automatic computer generated selection of one or more areas of interest.
  • the automatic computer generated selection of one or more areas of interest may select one area of interest comprising the area not included in the first area of interest.
  • Identifying at least a first area of interest may comprise an algorithm identifying features of interest in the first and/or second pre-image, such as facial recognition, wherein identifying at least a first area of interest may be based on said identified features of interest.
  • the step of obtaining user information may obtain user information comprising at least one user selected area of interest.
  • the user information may comprise desired properties corresponding to the selected at least one user selected area of interest.
  • the user selected area of interest may be an area of special interest to the user, such as an area representing the face of a person.
  • the step of obtaining user information may comprise obtaining user information relating to at least one desired property comprising an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
  • the step of obtaining user information may comprise obtaining user information relating to at least one desired property comprising an area of interest, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated.
  • the step of obtaining user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image.
  • the step of obtaining the digital image by calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
  • the weighted value for each area of interest of the first and/or second pre-image may be pre-set to a default weight value.
  • pre-set weighted values allows the user to only input user information comprising desired deviations from the default weight values.
  • Calculating the digital composite image may further comprise weighting the remaining area of the pre-images, areas not part of any area of interest, with a predetermined weighting value.
  • the digital composite image may be calculated pixel by pixel. In a preferred embodiment, the digital composite image is calculated pixel by pixel.
  • Calculating the digital composite image may comprise weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
  • the step of obtaining user information may comprise obtaining for each area of interest at least one amplification factor.
  • the step of obtaining the digital image by calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
  • the present disclosure further relates to a computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry the presently disclosed method.
  • the present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a processor, cause the processor to carry the presently disclosed method.
  • Figs la and lb shows schematically a portable electronic camera system
  • Fig. 2a and 2b shows schematically a portable electronic camera device
  • Fig. 3 depicts schematically an image representing a scene with an area of interest selected.
  • Fig. 4 shows schematically a flowchart of a method according to the present disclosure.
  • Fig. la and lb shows schematically a portable electronic camera system 100 for obtaining a digital composite image according to the present disclosure. It should be noted that not all depicted components are necessary for all embodiments of the portable electronic camera system.
  • the portable electronic camera system is arranged to calculate a digital composite image.
  • the example camera system 100 comprises an electronic camera device 110 and an illumination device 160.
  • the electronic camera device 110 comprises a housing 130, a digital camera 120 arranged to capture an image of a scene and a control element 140.
  • the digital camera 120 and the control element 140 are arranged inside and/or at the housing 130.
  • the illumination device 160 is arrange to illuminate at least part of the scene with a flash.
  • the control element 140 is arranged to communicate with the illumination device 160 via a communication interface.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160.
  • the portable electronic camera device 110 comprises a processor 141.
  • the control element 140 may comprise the processor 141.
  • Fig. la shows schematically an example of the portable electronic camera system 100 with the camera device 110 and the illumination device 160 facing into the plane of the drawing, while fig. lb shows the camera device 110 and the illumination device 160 facing out of the plane.
  • the relative positioning of the camera device 110 and the illumination device 160 is not limited to the relative positioning or size shown in the example portable electronic camera device 110 of fig. la or fig. lb.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain a first pre-image relating to at least part of the scene illuminated by ambient light and a flash of a first intensity.
  • the first pre-image may be obtained using predetermined pre image camera settings and/or illumination device settings.
  • the electronic camera device 110 and the illumination device 160 are arranged to capture an image while separated.
  • the electronic camera device 110 and the illumination device 160 connected via wired communication means may still be considered separate.
  • the scene refers to the field of view of the digital camera 120, as in the part of the world that is visible through the digital camera 120.
  • Ambient light refers to the light from all sources except the flash of light from the illumination device 160.
  • the first intensity may be zero intensity.
  • the portable electronic camera system 100 may comprise at least two illumination devices 160.
  • the illumination device (160) is attached to and/or comprised in the electronic camera device (110). In some embodiments the illumination device (160) is separate from the electronic camera device (110), and the control element (140) is arranged to communicate with the
  • illumination device (160) via a communication interface.
  • the communication interface may be a wireless communications interface, such as
  • Bluetooth and/or Wi-Fi transmitters and receivers are Bluetooth and/or Wi-Fi transmitters and receivers.
  • the illumination device 160 may comprise at least one artificial lighting light source 161.
  • the illumination device 160 may comprise at least one flashtube.
  • the illumination device 160 may comprise at least one flash LED.
  • the illumination device 160 may comprise communication means (not shown) arranged to communicate with the control element 140 of the electronic camera device 110.
  • the illumination device 160 may comprise a processor (no shown) arranged to control the communication means and the at least one artificial lighting light source 161.
  • the illumination device 160 may be an off-camera flash unit.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain second pre-image relating to at least part of the scene illuminated by ambient light and a flash of a second intensity.
  • the second pre-image may be obtained using predetermined pre image camera settings and/or illumination device settings.
  • the predetermined pre image camera settings for obtaining the first and second pre-image may be the same.
  • the pre image camera settings and/or illumination device settings for obtaining the second pre-image may be determined based on the obtained first pre-image.
  • Said pre image illumination device settings may be determined based on the level of exposure in the first pre-image.
  • the first or second intensity may be zero flash intensity, as in no flash being used.
  • the pre-image camera settings comprise sensor light sensitivity (ISO). In one example, the pre-image camera settings comprise lens opening (aperture). In one example, the pre-image camera settings comprise exposure time (shutter speed). In one example, the pre-image camera settings comprise light sensitivity, lens opening and exposure time, or any combination thereof. In one example the pre-image illumination device settings comprises mean light intensity during the exposure. In one example the pre-image illumination device settings comprises mean colour temperature. On one example, the pre-image illumination device settings comprises mean light intensity during the exposure and mean colour temperature.
  • the control element 140 is arranged to obtain user information relating to at least one desired property of the digital composite image to be calculated.
  • the user information may be received as user input prior to initiating the control element 140 to obtain a first or a second pre-image.
  • the user information may be received as user input prior to and/or after initiating the control element 140 to obtain a first or a second pre-image.
  • at least part of the user information is stored on a memory storage 142 comprised in the portable electronic camera device 110.
  • the control element 140 obtaining user information then comprises obtaining at least part of the user information by retrieving at last part of the user information stored in the memory storage 142.
  • the control element 140 is arranged to calculate the digital composite image based on the obtained first pre image, the obtained second pre image and the obtained user information.
  • the user information may comprise an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
  • the portable electronic camera device 110 may comprise a user interface 150 arranged to receive user input and/or user information.
  • the user interface 150 may comprise a touchscreen.
  • the user interface 150 may comprise at least one mechanical switch, such as a pushbutton.
  • the illumination device may comprise a user interface (not shown) arranged to receive user input and/or user information.
  • the portable electronic camera device 110 may comprise a memory storage 142 arranged to communicate with the control element 140 and/or store a computer program configured to perform at least parts of the disclosed calculations and/or communication with the digital camera 120 and/or the illumination device 160.
  • Said computer program may at least partly be run on the processor 141.
  • Said computer program may comprise instructions for controlling the digital camera 120 and/or the illumination device 160.
  • Said computer program may comprise instructions for obtaining the pre-image from the digital camera 120.
  • Said computer program may comprise instructions for obtaining and/or accessing and/or storing the user information relating to the desired property in at least part of the digital composite image to be calculated.
  • Said computer program can further comprise instructions for analysing and processing the pre-images and the user information.
  • Said computer program may comprise instructions for calculating the digital composite image based on the user information and the pre-images.
  • the computer program is a camera phone software program.
  • said computer program may be an application on a digital camera device, a camera phone, a smartphone or a tablet.
  • said computer program may be integrated into the operative system of a camera phone.
  • the control element 140 may be arranged to determine the pre-image camera settings and/or the pre-image illumination device settings utilizing any of the information from the user information and/or obtained pre image.
  • the aim of calculating the digital composite image may be to calculate the digital composite image best matching the at least one desired property.
  • the control element may determine the pre image illumination device settings for the second pre-image based on the first pre-image.
  • control element 140 obtains the first pre image, the second pre-image and the user information.
  • the control element actions needs the information acquired by performing another action as an input, such as the pre image illumination device settings for obtaining second pre-image being determined based on the first pre-image.
  • the portable electronic camera device 110 may be a digital camera device, a camera phone, smartphone or tablet utilizing a software application running on the operating system of said device to calculate the digital composite image.
  • Fig. 2a and 2b shows schematically a portable electronic camera device 190 for obtaining a digital composite image according to the present disclosure. It should be noted that not all depicted components are necessary for all embodiments of the portable electronic camera device.
  • the portable electronic camera device is arranged to calculate a digital composite image.
  • the portable electronic camera device 190 comprises a housing 130, a digital camera 120 arranged to capture an image of a scene, and a control element 140.
  • the digital camera 120 and the control element 140 are arranged inside and/or at the housing 130.
  • the control element 140 is arranged to communicate with an illumination device 160 arranged to illuminate at least part of the scene with a flash.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160.
  • the portable electronic camera device 190 may be an electronic camera device as described in fig. la and fig. lb.
  • the illumination device 160 may be an illumination device as described in fig. la and fig. lb.
  • the portable electronic camera device 190 comprises a processor 141.
  • the control element 140 may comprise the processor 141.
  • Fig. la shows schematically an example of the portable electronic camera device 190 with the digital camera 120 facing into the plane of the drawing, while fig. lb shows the electronic camera device 190 with the digital camera 120 facing out of the plane.
  • the relative positioning of the camera device 190 and the illumination device 160 is not limited to the relative positioning or size shown in the example portable electronic camera device 190 of fig. 2a or fig. 2b.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain a first pre-image relating to at least part of the scene illuminated by ambient light and a flash of a first intensity.
  • the first pre-image may be obtained using predetermined pre-image camera settings and/or illumination device settings.
  • Ambient light refers to the light from all sources except the flash of light from the illumination device 160.
  • First intensity may be zero intensity.
  • the flash of first intensity has zero intensity.
  • the control element 140 may be arranged to communicate with and control at least two illumination devices 160.
  • the control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain second pre-image relating to at least part of the scene illuminated by ambient light and a flash of a second intensity.
  • the second pre-image may be obtained using predetermined pre-image camera settings and/or illumination device settings.
  • the predetermined pre-image camera settings for obtaining the first and second pre-image may be the same.
  • the pre-image camera settings and/or illumination device settings for obtaining the second pre-image may be determined based on the obtained first pre-image.
  • Said pre-image illumination device settings may be determined based on the level of exposure in the first pre-image.
  • the first or second intensity may be zero flash intensity, as in no flash being used.
  • the pre-image camera settings comprise sensor light sensitivity (ISO). In one example, the pre-image camera settings comprise lens opening (aperture). In one example, the pre-image camera settings comprise exposure time (shutter speed). In one example, the pre-image camera settings comprise light sensitivity, lens opening and exposure time, or any combination thereof.
  • ISO sensor light sensitivity
  • the pre-image camera settings comprise lens opening (aperture). In one example, the pre-image camera settings comprise exposure time (shutter speed). In one example, the pre-image camera settings comprise light sensitivity, lens opening and exposure time, or any combination thereof.
  • the pre-image illumination device settings comprises mean light intensity during the exposure. In one example the pre-image illumination device settings comprises mean colour temperature. On one example, the pre-image illumination device settings comprises mean light intensity during the exposure and mean colour temperature.
  • the illumination device 160 may comprise at least one artificial lighting light source 161.
  • the illumination device 160 may comprise at least one flashtube.
  • the illumination device 160 may comprise at least one flash LED.
  • the illumination device 160 may comprise communication means (not shown) arranged to communicate with the control element 140 of the portable electronic camera device 190.
  • the illumination device 160 may comprise a processor (no shown) arranged to control the communication means and the at least one artificial lighting light source 161.
  • the illumination device 160 may be an off-camera flash unit.
  • the control element 140 is arranged to obtain user information relating to at least one desired property of the digital composite image to be calculated.
  • the user information may be received as user input prior to initiating the control element 140 to obtain a first or a second pre-image.
  • the user information may be received as user input prior to and/or after initiating the control element 140 to obtain a first or a second pre-image.
  • at least part of the user information is stored on a memory storage 142 comprised in the portable electronic camera device 190.
  • the control element 140 obtaining user information then comprises obtaining at least part of the user information by retrieving at last part of the user information stored in the memory storage 142.
  • the control element 140 is arranged to calculate the digital composite image based on the obtained first pre-image, the obtained second pre-image and the obtained user information.
  • the user information may comprise an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
  • the portable electronic camera device 190 may comprise a user interface 150 arranged to receive user input and/or user information.
  • the user interface 150 may comprise a touchscreen.
  • the user interface 150 may comprise at least one mechanical switch, such as a pushbutton.
  • the portable electronic camera device 190 may comprise a memory storage 142 arranged to communicate with the control element 140 and/or store a computer program configured to perform at least parts of the disclosed calculations and/or communication with the digital camera 120 and/or the illumination device 160.
  • Said computer program may at least partly be run on the processor 141.
  • Said computer program may comprise instructions for controlling the digital camera 120 and/or the illumination device 160.
  • Said computer program may comprise instructions for obtaining the pre-image from the digital camera 120.
  • Said computer program may comprise instructions for obtaining and/or accessing and/or storing the user information relating to the desired property in at least part of the digital composite image to be calculated.
  • Said computer program can further comprise instructions for analysing and processing the pre-images and the user information.
  • Said computer program may comprise instructions for calculating the digital composite image based on the user information and the pre-images.
  • the computer program is a camera phone software program.
  • said computer program may be an application on a digital camera device, a camera phone, a smartphone or a tablet.
  • said computer program may be integrated into the operative system of a camera phone.
  • the control element 140 may be arranged to determine the pre-image camera settings and/or the pre-image illumination device settings utilizing any of the information from the user information and/or obtained pre-image.
  • the aim of calculating the digital composite image may be to calculate the digital composite image best matching the at least one desired property.
  • the control element may determine the pre-image illumination device settings for the second pre-image based on the first pre-image.
  • control element 140 obtains the first pre-image, the second pre-image and the user information.
  • the control element actions needs the information acquired by performing another action as an input, such as the pre-image illumination device settings for obtaining second pre-image being determined based on the first pre-image.
  • the portable electronic camera device 190 may be a digital camera device, a camera phone, smartphone or tablet utilizing a software application running on the operating system of said device to calculate the digital composite image.
  • Fig. 3 shows an illustration of an image representing a scene 300 with two different areas of interest 310 selected.
  • the selected area of interest 310 of an image representing the scene 300 is defined by the user.
  • the selected at least one area of interest 310 of an image representing the scene 300 is defined based on the two pre-images.
  • the selected at least one area of interest 310 of an image representing the scene 300 is defined based on at least one facial recognition algorithm utilizing the first and/or second pre-image.
  • the selected at least one area of interest 310 of an image representing the scene 300 is defined based on the comparison between the two pre-images.
  • the control element may be arranged to identify at least a first area of interest 310 in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest 310.
  • the area of interest 310 may be identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
  • the user may select an area of interest 310 among at least one suggested area of interest 310 of an image representing the scene 300 calculated based on the comparison between the two pre-images.
  • the selected area of interest 310 of an image representing the scene 300 is predetermined.
  • One example of a predetermined area of interest 310 is a rectangle centred and covering 50% of the image representing the scene 300, whereby the digital composite image is calculated in order to match the desired properties in the centre of the digital composite image.
  • the selected at least one area of interest 310 of an image representing the scene 300 may be the area of interest 310 of the digital composite image to be calculated for which the control element attempts to match the desired properties.
  • the control element may calculate at least one selected area of interest 310 of an image representing the scene 300.
  • the selected at least one area of interest 310 of an image representing the scene 300 may be the area of interest 310 taken in account when calculating the digital composite image, see Fig. 3.
  • the selected area of interest 310 of an image representing the scene 300 may instead or in addition thereto be user selected and/or automatically selected based on the first and/or second of pre-image.
  • the control element may calculate at least one suggested area of interest 310 of an image representing the scene 300 based on the first and second pre-image for the user to select among.
  • the control element may calculate the digital composite image so as to best achieve the at least one user desired property in at least one area of the digital composite image to be calculated, wherein at least one area of the digital composite image correlates to the at least one user selected and/or calculated area of interest 310 of an image representing the scene 300.
  • the user information relating to at least one desired property may comprise an area of interest of an image representing the scene 300, and wherein at least one of the at least one desired property is a desired property of the corresponding area of the digital composite image to be calculated.
  • the user interface may be configured to receive at least one user selection of at least one area of interest 310 of an image representing the scene 300.
  • the obtained user information relating to at least one desired property of the digital composite image to be calculated may relate to the whole of the digital composite image or at least one part thereof.
  • the user information may comprise an area of interest 310 of an image representing the scene 300, wherein the area of interest 310 corresponds to an area the digital composite image to be calculated for which the control element attempts to match the at least one desired property.
  • At least part of the user information relating to at least one desired property of the digital composite image to be calculated may be stored on the memory storage. All user information relating to desired properties of the digital composite image to be calculated may be stored on the memory storage, whereby once user information is stored the user may operate the portable electronic camera device repeatedly without inputting new user information.
  • the obtained user information may comprise obtaining for each area of interest 310 a first weighting value for the first pre-image, and obtaining for each area of interest 310 a second weighting value for the difference between the first pre-image and the second pre-image.
  • Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of
  • Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest 310 with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest 310 with a second predetermined weighting value.
  • Obtaining the user information may comprises obtaining for each area of interest 310 at least one amplification factor.
  • Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest 310 with the corresponding amplification factor.
  • Obtaining the user information may comprise obtaining, for each area of interest 310, a chromaticity adjustment value.
  • Calculating the digital composite image comprises, for each area of interest 310, adjusting chromaticity based on the corresponding chromaticity adjustment value.
  • Fig. 4 shows schematically a flowchart of a method according to the present disclosure.
  • the method 400 comprising the steps of obtaining user information 410, obtaining a first pre-image 420 of a scene illuminated by ambient light and a flash of a first intensity, obtaining a second pre-image 430 of the scene illuminated by ambient light and a flash of a second intensity, obtaining the digital image by calculating a digital composite image 440 based on the first pre-image and the second pre-image.
  • the step of obtaining user information 410 comprises obtaining user information relating to the calculation of the digital composite image. Calculating the digital composite image 440 is based on the user information, the first pre-image and the second pre-image.
  • the method may be arranged to obtain a digital composite image with the digital camera and at least two illumination devices.
  • the method may be arranged to obtain a digital composite image with the digital camera and the illumination device are comprised in a portable electronic camera device.
  • the method may be arranged to obtain a digital composite image with the digital camera and the illumination device, wherein the illumination device is an external illumination device in communication with the digital camera via a communication interface.
  • the first or second intensity may be of zero flash intensity, as in no flash being used.
  • the flash of first intensity has zero intensity.
  • the step of obtaining user information 410 may comprise obtaining user information comprising at least one user selected region of an image representing the scene.
  • the user information may comprise desired properties corresponding to the selected at least one user selected region.
  • the user selected region may be a region of special interest to the user, such as a region of an image wherein the region represents the face of a person.
  • the step of obtaining 410 user information may comprise user information relating to at least one desired property comprises an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
  • the step of obtaining a first pre-image 420 and/or obtaining a second pre-image 430 may comprise determining pre-image camera settings comprising a sensor light sensitivity setting and/or an aperture setting and/or an exposure duration setting.
  • the step of obtaining a first pre-image 420 and/or obtaining a second pre-image 430 may comprise determining pre-image illumination device settings comprising a mean light intensity during the exposure setting and/or a mean colour temperature setting.
  • the method for obtaining a digital composite image may comprise the step of identifying at least a first area of interest in the first pre-image and the second pre-image.
  • the step of obtaining the digital image by calculating the digital composite image 440 is based also on the identified area of interest.
  • the area of interest may be identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
  • the step of obtaining 410 user information may comprise user information relating to at least one desired property comprising an area of interest of an image representing at least part of the scene, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated.
  • the step of obtaining 410 user information may comprise obtaining user information relating to at least one desired property comprising an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
  • the step of obtaining 410 user information may comprise obtaining user information relating to at least one desired property comprising an area of interest of an image representing at least part of the scene, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated.
  • the step of obtaining user information 410 may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre image.
  • the step of obtaining the digital image by calculating the digital composite image 440 may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
  • Calculating the digital composite image may comprise weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
  • the step of obtaining user information 410 may comprise obtaining for each area of interest at least one amplification factor.
  • Calculating the digital composite image 440 may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
  • the step of obtaining user information 410 may comprise the step of obtaining, for each area of interest, a chromaticity adjustment value.
  • Calculating the digital composite image may comprise, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
  • the present disclosure further relates to a computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry out at least part of the presently disclosed method.
  • the present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a processor, cause the processor to carry out at least part of the presently disclosed method.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

The present disclosure relates to a portable electronic camera system (100) for obtaining a digital image, wherein the portable electronic camera system (100) comprises an illumination device (160) arranged to illuminate at least part of a scene with a flash, and an electronic camera device (110) comprising a control element (140), and a digital camera (120) arranged to capture an image of the scene. The control element (140) is arranged to communicate with the illumination device (160). The control element (140) is arranged to control the digital camera (120) and the illumination device (160). The control element (140) is arranged to control the digital camera (120) and the illumination device (160) to obtain a first pre image relating to the scene illuminated by ambient light and a flash of a first intensity; control the digital camera (120) and the illumination device (160) to obtain a second pre image relating to the scene illuminated by ambient light and a flash of a second intensity; obtain user information relating to calculation of a digital composite image; identify at least a first area of interest in the first pre-image and the second pre-image; and obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre image and the obtained second pre-image. Obtaining the user information comprises obtaining for each area of interest at least one amplification factor, and calculating the digital composite image comprises amplifying the first pre-image and amplifying the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.

Description

A PORTABLE ELECTRON IC CAMERA SYSTEM, A PORTABLE ELECTRONIC CAMERA DEVICE AND METHOD FOR OBTAI NI NG A DIGITAL IMAGE
TECHN ICAL FI ELD
The present disclosure relates to a portable electronic camera device configured to obtain a digital image.
BACKGROUND
Historically the primary use of illumination devices, such as flash devices, in image capture has been to capture images under low ambient light conditions. Artificial lighting may also be used to change the property of a captured digital composite image. I n order to capture a digital composite image with certain desired optical characteristics, such as the relationship between luminous exposure from ambient and artificial light, certain settings for the digital camera and lighting device(s) are obtained. Settings which are adjustable may include ISO, aperture and exposure time settings for the camera and intensity, duration and colour temperature settings for the lighting device(s). Some digital single-lens reflex (DSLR) cameras allow the user to input a desired exposure compensation which either underexposes or overexposes the image.
When capturing flash photos with a smartphone one of the problems is that the flash usually is small and is capable of emitting only a limited amount of light. To be able to achieve a noticeable effect from the flash, the ambient light need to be small in comparison.
Additionally, most cameras are very light sensitive with a large fixed aperture on the lens of the camera and a high sensitivity of the sensor. The large fixed aperture of the lens of the camera and high sensitivity of the sensor makes it possible to capture light under low light conditions but makes it difficult to supress the ambient light without having a short exposure time. However, most smartphones have a rolling shutter with a rolling readout and a rolling reset. Thus, all pixels are not receptive for light simultaneously which is noticeable especially when the exposure time is short. Thus, when a short flash is used to illuminate the scene only some rows in the sensor will be exposed during the flash. If all pixels should be receptive for light simultaneously the exposure time will be in the range of 10-50 ms. Such a long exposure time will allow a lot of ambient light to hit the sensor. The exposure time is usually called minimum x-sync shutter speed.
SUMMARY
With the high prevalence of devices comprising digital cameras and devices able to produce a flash of artificial light, such as digital camera devices, camera phones, smartphones, tablets or off-camera flash units, there exists a large population of users with limited understanding of camera and lighting settings.
One object of the invention is to facilitate and/or improve the capture of digital composite images for the user.
This has in accordance with the present disclosure been achieved by means of a portable electronic camera system for obtaining a digital image. Wherein the portable electronic camera system comprises an illumination device arranged to illuminate at least part of a scene with a flash, and an electronic camera device comprising a control element, and a digital camera arranged to capture an image of the scene. The control element is arranged to communicate with the illumination device. The control element is arranged to control the digital camera and the illumination device. The control element is arranged to control the digital camera and the illumination device to obtain a first pre image relating to the scene illuminated by ambient light and a flash of a first intensity; control the digital camera and the illumination device to obtain a second pre image relating to the scene illuminated by ambient light and a flash of a second intensity; obtain user information relating to calculation of a digital composite image, identify at least a first area of interest in the first pre-image and the second pre image, and obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre image and the obtained second pre-image. Obtaining the user information comprises obtaining for each area of interest at least one amplification factor, and calculating the digital composite image comprises amplifying the first pre-image and amplifying the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
Scene refers to the field of view of the digital camera, as in the part of the world that is visible through the digital camera.
Ambient light refers to the light from all sources except the flash of light from the
illumination device.
The first or second intensity may be of zero flash intensity, as in no flash being used. In a preferred embodiment, the flash of first intensity has zero intensity, i.e., no flash is used for the first pre-image.
In some embodiments, the portable electronic camera system comprises at least two illumination devices.
The illumination device may comprise communication means arranged to communicate with the control element of the electronic camera device. The illumination device may comprise at least one artificial lighting light source arranged to generate a flash of light. The illumination device may comprise a processor arranged to control the communication means and the at least one artificial lighting light source.
The aim of calculating the digital composite image may be to create an image with properties matching the at least one desired property. Thereby the digital composite image may be automatically calculated based on user preferences.
This has the advantage that settings may not need to be manually changed during use. The portable electronic camera system also allows users with limited experience of digital camera settings and/or illumination device settings to successfully operate the portable electronic camera system.
The invention also allows for calculating the digital composite image with at least one desired user defined property, such as relative luminous exposure, exposure value or white balance. Thus, the portable electronic camera system allows for calculating the digital composite image with a user defined relationships between the luminous exposure from the scene with and without a flash without manual changes to digital camera settings and/or illumination device settings.
Further, the portable electronic camera system allows for calculating the digital composite image with a user defined exposure value without manual changes to digital camera settings and/or illumination device settings.
Further, the above portable electronic camera system allows for calculating the digital composite image with a user defined white balance without manual changes to digital camera settings and/or illumination device settings.
The portable electronic camera system may comprise a user interface arranged to receive at least part of the user information.
The user information relating to at least one desired property may comprise an exposure value and/or a chromaticity and/or a relation between luminous exposure with and without a flash.
The control element may be arranged to control the digital camera and/or the illumination device to obtain the first and/or the second pre-image, wherein pre-image camera settings and/or pre-image illumination device settings are determined and set.
The control element may be arranged to set pre-image camera settings and/or pre-image illumination device settings, and control the digital camera and/or illumination device to capture a pre-image.
The control element may be arranged to identify at least a first area of interest in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest. The area of interest is identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process. The user interface may be arranged to receive user information comprising the user selection of at least one area of interest in the first pre-image and the second pre-image.
In one example, the control element is arranged to calculate the digital composite image so as to obtain a desired relation between luminous exposure from the scene with and without a flash in at least one area of interest of said digital composite image. The relation between the luminous exposures correlates the relationship in brightness between objects in the scene illuminated by a flash and objects illuminated significantly less by a flash, such as an object close to and an object far away from the electronic camera device.
In one example, the control element is arranged to calculate the digital composite image so as to obtain a desired exposure value in at least one area of interest of said digital composite image.
In one example, the control element is arranged to calculate the digital composite image so as to obtain a desired white balance in at least one area of interest of said digital composite image.
The obtained user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image. Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
The term "weighting" relates to forming weighted arithmetic means. Unless otherwise specified the weights are normalized, such that weighting two pixel values results in a value within an interval between the two pixels.
The weight value for each area of interest of the first and/or second pre-image may be pre set to a default weight value. The use of pre-set weighted values allows the user to only input user information comprising desired deviations from the default weight values. Calculating the digital composite image may further comprise weighting the remaining area of the pre-images, areas not part of any area of interest, with a predetermined weighting value.
The digital composite image may be calculated pixel by pixel. In a preferred embodiment, the digital composite image is calculated pixel by pixel.
Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
Obtaining the user information may comprises obtaining for each area of interest at least one amplification factor. Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre image in each area of interest with the corresponding amplification factor.
The term "amplifying" relates to multiplication of a value. Amplification may comprise multiplying a value with an amplification factor below one, resulting in a reduced output value. In some examples amplifying an area of interest while calculating a digital composite image may result in values that are higher (or lower) than both the corresponding values for the first pre image and the second pre image. Amplifying as opposed to weighting is typically not limited to values between the input values.
Obtaining the user information may comprise obtaining, for each area of interest, a chromaticity adjustment value. Calculating the digital composite image comprises, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
The chromaticity adjustment value may be set to zero by default. In a preferred
embodiment, the default chromaticity adjustment value is set to zero.
The electronic camera device may be integrated into an electronic user device, such as a digital camera device, a camera phone, a smartphone or a tablet. Said electronic camera device may be a camera phone, a smartphone or a tablet. The electronic camera device may utilize a camera phone software application configured to control a digital camera and an illumination device, and to calculate the digital composite image.
The electronic camera device may comprises a processor. The electronic camera device may comprises a memory storage. The control element may comprise the processor and the memory storage comprising at least one computer program. The computer program is configured to perform at least part of the control, the communication and calculations described in the present disclosure.
The present disclosure further relates to a portable electronic camera device for obtaining a digital image, wherein the portable electronic camera device comprises a digital camera arranged to capture an image of a scene, and a control element. The control element is arranged to communicate with an illumination device arranged to illuminate at least part of the scene with a flash. The control element is arranged to control the digital camera and the illumination device. The control element is arranged to control the digital camera and the illumination device to obtain a first pre-image relating to the scene illuminated by ambient light and a flash of a first intensity; control the digital camera and the illumination device to obtain a second pre-image relating to the scene illuminated by ambient light and a flash of a second intensity; obtain user information relating to calculation of a digital composite image; and obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre-image and the obtained second pre-image.
Scene refers to the field of view of the digital camera, as in the part of the world that is visible through the digital camera.
Ambient light refers to the light from all sources except the flash of light from the illumination device.
The first or second intensity may be of zero flash intensity, as in no flash being used. In a preferred embodiment, the flash of first intensity has zero intensity, i.e., no flash is used for the first pre-image.
When the control element controls the digital camera and the illumination device to obtain a first pre-image with no flash from the illumination device, it is to be understood that the control element controls the illumination device to be turned off, i.e., to not illuminate a flash.
In some embodiments, the control element is arranged to communicate with and control at least two illumination devices.
The illumination device may comprise communication means arranged to communicate with the control element of the electronic camera device. The illumination device may comprise at least one artificial lighting light source arranged to generate a flash of light. The illumination device may comprise a processor arranged to control the communication means and the at least one artificial lighting light source.
The aim of calculating the digital composite image may be to create an image with properties matching the at least one desired property. Thereby the digital composite image may be automatically calculated based on user preferences.
This has the advantage that settings may not need to be manually changed during use. The portable electronic camera device also allows users with limited experience of digital camera settings and/or illumination device settings to successfully operate the portable electronic camera device.
The invention also allows for calculating the digital composite image with at least one desired user defined property, such as relative luminous exposure, exposure value or white balance.
Thus, the portable electronic camera device allows for calculating the digital composite image with a user defined relationships between the luminous exposure from the scene with and without a flash without manual changes to digital camera settings and/or illumination device settings.
The portable electronic camera device may comprise a user interface arranged to receive at least part of the user information. The user information relating to at least one desired property may comprise an exposure value and/or a chromaticity and/or a relation between luminous exposure with and without a flash.
The control element may be arranged to control the digital camera and/or the illumination device to obtain the first and/or the second pre-image, wherein pre-image camera settings and/or pre-image illumination device settings are determined and set.
The control element may be arranged to set pre-image camera settings and/or pre-image illumination device settings, and control the digital camera and/or illumination device to capture a pre-image.
The control element may be arranged to identify at least a first area of interest in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest. The area of interest is identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
The area of interest relates to the same area in both pre-images. If only one area of interest is identified the digital composite image may only represent the area of the area of interest.
Identifying at least a first area of interest may comprise the user actively selecting the first area of interest followed by an automatic computer generated selection of one or more areas of interest. The automatic computer generated selection of one or more areas of interest may select one area of interest comprising the area not included in the first area of interest.
Identifying at least a first area of interest may comprise an algorithm identifying features of interest in the first and/or second pre-image, such as facial recognition, wherein identifying at least a first area of interest may be based on said identified features of interest.
The user interface may be arranged to receive user information comprising the user selection of at least one area of interest in the first pre-image and the second pre-image. In one example, the control element is arranged to calculate the digital composite image so as to obtain a desired relation between luminous exposure from the scene with and without a flash in at least one area of interest of said digital composite image. The relation between the luminous exposures correlates the relationship in brightness between objects in the scene illuminated by a flash and objects illuminated significantly less by a flash, such as an object close to and an object far away from the portable electronic camera device.
The obtained user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image. Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
Obtaining the user information may comprises obtaining for each area of interest at least one amplification factor. Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre image in each area of interest with the corresponding amplification factor.
Obtaining the user information may comprise obtaining, for each area of interest, a chromaticity adjustment value. Calculating the digital composite image comprises, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
The chromaticity adjustment value may be set to zero by default. In a preferred
embodiment, the default chromaticity adjustment value is set to zero.
Said portable electronic camera device may be integrated into an electronic user device, such as a digital camera device, a camera phone, a smartphone or a tablet. Said portable electronic camera device may be a digital camera device, a camera phone, a smartphone or a tablet. The portable electronic camera device may utilize a camera phone software application configured to control a digital camera and an illumination device, and to calculate the digital composite image.
The portable electronic camera device may comprises a processor. The portable electronic camera device may comprises a memory storage. The control element may comprise the processor and the memory storage comprising at least one computer program. The computer program is configured to perform at least part of the control, the communication and calculations described in the present disclosure.
The present disclosure further relates to a method for obtaining a digital composite image with a digital camera and an illumination device, the method comprising the steps of obtaining user information, obtaining a first pre-image of a scene by the digital camera illuminated by ambient light and a flash of a first intensity by the illumination device, obtaining a second pre-image of the scene by the digital camera illuminated by ambient light and a flash of a second intensity by the illumination device, and obtaining the digital image by calculating a digital composite image based on the first pre-image and the second pre image. The step of obtaining user information comprises obtaining user information relating to the calculation of the digital composite image. Calculating the digital composite image is based on the user information, the first pre-image and the second pre-image.
In one embodiment, the method is arranged to obtain a digital composite image with the digital camera and at least two illumination devices.
In one embodiment, the digital camera and the illumination device are comprised in a portable electronic camera device.
In one embodiment, the illumination device is an external illumination device in
communication with the digital camera via a communication interface.
The first or second intensity may be of zero flash intensity, as in no flash being used. In a preferred embodiment, the flash of first intensity has zero intensity. The method for obtaining a digital composite image may comprise the step of identifying at least a first area of interest in the first pre-image and the second pre-image. The step of obtaining the digital image by calculating the digital composite image is based also on the identified area of interest. The area of interest may be identified as being the entire first pre image and second pre-image, based on the user information, or identified by an automatic identification process.
The area of interest relates to the same area in both pre-images. If only one area of interest is identified the digital composite image may only represent the area of the area of interest.
Identifying at least a first area of interest may comprise the user actively selecting the first area of interest followed by an automatic computer generated selection of one or more areas of interest. The automatic computer generated selection of one or more areas of interest may select one area of interest comprising the area not included in the first area of interest.
Identifying at least a first area of interest may comprise an algorithm identifying features of interest in the first and/or second pre-image, such as facial recognition, wherein identifying at least a first area of interest may be based on said identified features of interest.
The step of obtaining user information may obtain user information comprising at least one user selected area of interest. The user information may comprise desired properties corresponding to the selected at least one user selected area of interest. The user selected area of interest may be an area of special interest to the user, such as an area representing the face of a person.
The step of obtaining user information may comprise obtaining user information relating to at least one desired property comprising an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
The step of obtaining user information may comprise obtaining user information relating to at least one desired property comprising an area of interest, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated. The step of obtaining user information may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre-image. The step of obtaining the digital image by calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
The weighted value for each area of interest of the first and/or second pre-image may be pre-set to a default weight value. The use of pre-set weighted values allows the user to only input user information comprising desired deviations from the default weight values.
Calculating the digital composite image may further comprise weighting the remaining area of the pre-images, areas not part of any area of interest, with a predetermined weighting value.
The digital composite image may be calculated pixel by pixel. In a preferred embodiment, the digital composite image is calculated pixel by pixel.
Calculating the digital composite image may comprise weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
The step of obtaining user information may comprise obtaining for each area of interest at least one amplification factor. The step of obtaining the digital image by calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
The present disclosure further relates to a computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry the presently disclosed method. The present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a processor, cause the processor to carry the presently disclosed method.
BRIEF DESCRIPTION OF THE DRAWINGS
Figs la and lb shows schematically a portable electronic camera system
Fig. 2a and 2b shows schematically a portable electronic camera device
Fig. 3 depicts schematically an image representing a scene with an area of interest selected.
Fig. 4 shows schematically a flowchart of a method according to the present disclosure.
DETAILED DESCRIPTION
Throughout the figures, same reference numerals refer to same parts, concepts, and/or elements. Consequently, what will be said regarding a reference numeral in one figure applies equally well to the same reference numeral in other figures unless not explicitly stated otherwise.
Fig. la and lb shows schematically a portable electronic camera system 100 for obtaining a digital composite image according to the present disclosure. It should be noted that not all depicted components are necessary for all embodiments of the portable electronic camera system. The portable electronic camera system is arranged to calculate a digital composite image.
The example camera system 100 comprises an electronic camera device 110 and an illumination device 160. The electronic camera device 110 comprises a housing 130, a digital camera 120 arranged to capture an image of a scene and a control element 140. The digital camera 120 and the control element 140 are arranged inside and/or at the housing 130. The illumination device 160 is arrange to illuminate at least part of the scene with a flash. The control element 140 is arranged to communicate with the illumination device 160 via a communication interface. The control element 140 is arranged to control the digital camera 120 and the illumination device 160.
The portable electronic camera device 110 comprises a processor 141. The control element 140 may comprise the processor 141. Fig. la shows schematically an example of the portable electronic camera system 100 with the camera device 110 and the illumination device 160 facing into the plane of the drawing, while fig. lb shows the camera device 110 and the illumination device 160 facing out of the plane. The relative positioning of the camera device 110 and the illumination device 160 is not limited to the relative positioning or size shown in the example portable electronic camera device 110 of fig. la or fig. lb.
The control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain a first pre-image relating to at least part of the scene illuminated by ambient light and a flash of a first intensity. The first pre-image may be obtained using predetermined pre image camera settings and/or illumination device settings.
The electronic camera device 110 and the illumination device 160 are arranged to capture an image while separated. The electronic camera device 110 and the illumination device 160 connected via wired communication means may still be considered separate.
Here the scene refers to the field of view of the digital camera 120, as in the part of the world that is visible through the digital camera 120.
Ambient light refers to the light from all sources except the flash of light from the illumination device 160.
The first intensity may be zero intensity.
The portable electronic camera system 100 may comprise at least two illumination devices 160.
In some embodiments the illumination device (160) is attached to and/or comprised in the electronic camera device (110). In some embodiments the illumination device (160) is separate from the electronic camera device (110), and the control element (140) is arranged to communicate with the
illumination device (160) via a communication interface.
The communication interface may be a wireless communications interface, such as
Bluetooth and/or Wi-Fi transmitters and receivers.
The illumination device 160 may comprise at least one artificial lighting light source 161. The illumination device 160 may comprise at least one flashtube. The illumination device 160 may comprise at least one flash LED.
The illumination device 160 may comprise communication means (not shown) arranged to communicate with the control element 140 of the electronic camera device 110. The illumination device 160 may comprise a processor (no shown) arranged to control the communication means and the at least one artificial lighting light source 161.
The illumination device 160 may be an off-camera flash unit.
The control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain second pre-image relating to at least part of the scene illuminated by ambient light and a flash of a second intensity. The second pre-image may be obtained using predetermined pre image camera settings and/or illumination device settings. The predetermined pre image camera settings for obtaining the first and second pre-image may be the same. The pre image camera settings and/or illumination device settings for obtaining the second pre-image may be determined based on the obtained first pre-image. Said pre image illumination device settings may be determined based on the level of exposure in the first pre-image.
The first or second intensity may be zero flash intensity, as in no flash being used.
In one example the pre-image camera settings comprise sensor light sensitivity (ISO). In one example, the pre-image camera settings comprise lens opening (aperture). In one example, the pre-image camera settings comprise exposure time (shutter speed). In one example, the pre-image camera settings comprise light sensitivity, lens opening and exposure time, or any combination thereof. In one example the pre-image illumination device settings comprises mean light intensity during the exposure. In one example the pre-image illumination device settings comprises mean colour temperature. On one example, the pre-image illumination device settings comprises mean light intensity during the exposure and mean colour temperature.
The control element 140 is arranged to obtain user information relating to at least one desired property of the digital composite image to be calculated. The user information may be received as user input prior to initiating the control element 140 to obtain a first or a second pre-image. The user information may be received as user input prior to and/or after initiating the control element 140 to obtain a first or a second pre-image. In one example at least part of the user information is stored on a memory storage 142 comprised in the portable electronic camera device 110. The control element 140 obtaining user information then comprises obtaining at least part of the user information by retrieving at last part of the user information stored in the memory storage 142.
The control element 140 is arranged to calculate the digital composite image based on the obtained first pre image, the obtained second pre image and the obtained user information.
The user information may comprise an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
The portable electronic camera device 110 may comprise a user interface 150 arranged to receive user input and/or user information. The user interface 150 may comprise a touchscreen. The user interface 150 may comprise at least one mechanical switch, such as a pushbutton.
The illumination device may comprise a user interface (not shown) arranged to receive user input and/or user information.
The portable electronic camera device 110 may comprise a memory storage 142 arranged to communicate with the control element 140 and/or store a computer program configured to perform at least parts of the disclosed calculations and/or communication with the digital camera 120 and/or the illumination device 160. Said computer program may at least partly be run on the processor 141. Said computer program may comprise instructions for controlling the digital camera 120 and/or the illumination device 160. Said computer program may comprise instructions for obtaining the pre-image from the digital camera 120. Said computer program may comprise instructions for obtaining and/or accessing and/or storing the user information relating to the desired property in at least part of the digital composite image to be calculated. Said computer program can further comprise instructions for analysing and processing the pre-images and the user information. Said computer program may comprise instructions for calculating the digital composite image based on the user information and the pre-images.
In one example, the computer program is a camera phone software program. In one example, said computer program may be an application on a digital camera device, a camera phone, a smartphone or a tablet. In one example, said computer program may be integrated into the operative system of a camera phone.
The control element 140 may be arranged to determine the pre-image camera settings and/or the pre-image illumination device settings utilizing any of the information from the user information and/or obtained pre image. The aim of calculating the digital composite image may be to calculate the digital composite image best matching the at least one desired property.
The control element may determine the pre image illumination device settings for the second pre-image based on the first pre-image.
The only restriction regarding the order of the control element 140 obtaining the first pre image, the second pre-image and the user information, arises in case one of said control element actions needs the information acquired by performing another action as an input, such as the pre image illumination device settings for obtaining second pre-image being determined based on the first pre-image.
In one example, the portable electronic camera device 110 may be a digital camera device, a camera phone, smartphone or tablet utilizing a software application running on the operating system of said device to calculate the digital composite image. Fig. 2a and 2b shows schematically a portable electronic camera device 190 for obtaining a digital composite image according to the present disclosure. It should be noted that not all depicted components are necessary for all embodiments of the portable electronic camera device. The portable electronic camera device is arranged to calculate a digital composite image.
The portable electronic camera device 190 comprises a housing 130, a digital camera 120 arranged to capture an image of a scene, and a control element 140. The digital camera 120 and the control element 140 are arranged inside and/or at the housing 130. The control element 140 is arranged to communicate with an illumination device 160 arranged to illuminate at least part of the scene with a flash. The control element 140 is arranged to control the digital camera 120 and the illumination device 160.
The portable electronic camera device 190 may be an electronic camera device as described in fig. la and fig. lb. The illumination device 160 may be an illumination device as described in fig. la and fig. lb.
The portable electronic camera device 190 comprises a processor 141. The control element 140 may comprise the processor 141. Fig. la shows schematically an example of the portable electronic camera device 190 with the digital camera 120 facing into the plane of the drawing, while fig. lb shows the electronic camera device 190 with the digital camera 120 facing out of the plane. The relative positioning of the camera device 190 and the illumination device 160 is not limited to the relative positioning or size shown in the example portable electronic camera device 190 of fig. 2a or fig. 2b.
The control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain a first pre-image relating to at least part of the scene illuminated by ambient light and a flash of a first intensity. The first pre-image may be obtained using predetermined pre-image camera settings and/or illumination device settings.
Here the scene refers to the field of view of the digital camera 120, as in the part of the world that is visible through the digital camera 120. Ambient light refers to the light from all sources except the flash of light from the illumination device 160.
First intensity may be zero intensity. In a preferred embodiment, the flash of first intensity has zero intensity.
The control element 140 may be arranged to communicate with and control at least two illumination devices 160.
The control element 140 is arranged to control the digital camera 120 and the illumination device 160 to obtain second pre-image relating to at least part of the scene illuminated by ambient light and a flash of a second intensity. The second pre-image may be obtained using predetermined pre-image camera settings and/or illumination device settings. The predetermined pre-image camera settings for obtaining the first and second pre-image may be the same. The pre-image camera settings and/or illumination device settings for obtaining the second pre-image may be determined based on the obtained first pre-image. Said pre-image illumination device settings may be determined based on the level of exposure in the first pre-image.
The first or second intensity may be zero flash intensity, as in no flash being used.
In one example, the pre-image camera settings comprise sensor light sensitivity (ISO). In one example, the pre-image camera settings comprise lens opening (aperture). In one example, the pre-image camera settings comprise exposure time (shutter speed). In one example, the pre-image camera settings comprise light sensitivity, lens opening and exposure time, or any combination thereof.
In one example the pre-image illumination device settings comprises mean light intensity during the exposure. In one example the pre-image illumination device settings comprises mean colour temperature. On one example, the pre-image illumination device settings comprises mean light intensity during the exposure and mean colour temperature.
The illumination device 160 may comprise at least one artificial lighting light source 161. The illumination device 160 may comprise at least one flashtube. The illumination device 160 may comprise at least one flash LED. The illumination device 160 may comprise communication means (not shown) arranged to communicate with the control element 140 of the portable electronic camera device 190. The illumination device 160 may comprise a processor (no shown) arranged to control the communication means and the at least one artificial lighting light source 161.
The illumination device 160 may be an off-camera flash unit.
The control element 140 is arranged to obtain user information relating to at least one desired property of the digital composite image to be calculated. The user information may be received as user input prior to initiating the control element 140 to obtain a first or a second pre-image. The user information may be received as user input prior to and/or after initiating the control element 140 to obtain a first or a second pre-image. In one example at least part of the user information is stored on a memory storage 142 comprised in the portable electronic camera device 190. The control element 140 obtaining user information then comprises obtaining at least part of the user information by retrieving at last part of the user information stored in the memory storage 142.
The control element 140 is arranged to calculate the digital composite image based on the obtained first pre-image, the obtained second pre-image and the obtained user information.
The user information may comprise an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
The portable electronic camera device 190 may comprise a user interface 150 arranged to receive user input and/or user information. The user interface 150 may comprise a touchscreen. The user interface 150 may comprise at least one mechanical switch, such as a pushbutton.
The portable electronic camera device 190 may comprise a memory storage 142 arranged to communicate with the control element 140 and/or store a computer program configured to perform at least parts of the disclosed calculations and/or communication with the digital camera 120 and/or the illumination device 160. Said computer program may at least partly be run on the processor 141. Said computer program may comprise instructions for controlling the digital camera 120 and/or the illumination device 160. Said computer program may comprise instructions for obtaining the pre-image from the digital camera 120. Said computer program may comprise instructions for obtaining and/or accessing and/or storing the user information relating to the desired property in at least part of the digital composite image to be calculated. Said computer program can further comprise instructions for analysing and processing the pre-images and the user information. Said computer program may comprise instructions for calculating the digital composite image based on the user information and the pre-images.
In one example, the computer program is a camera phone software program. In one example, said computer program may be an application on a digital camera device, a camera phone, a smartphone or a tablet. In one example, said computer program may be integrated into the operative system of a camera phone.
The control element 140 may be arranged to determine the pre-image camera settings and/or the pre-image illumination device settings utilizing any of the information from the user information and/or obtained pre-image. The aim of calculating the digital composite image may be to calculate the digital composite image best matching the at least one desired property.
The control element may determine the pre-image illumination device settings for the second pre-image based on the first pre-image.
The only restriction regarding the order of the control element 140 obtaining the first pre-image, the second pre-image and the user information, arises in case one of said control element actions needs the information acquired by performing another action as an input, such as the pre-image illumination device settings for obtaining second pre-image being determined based on the first pre-image.
In one example, the portable electronic camera device 190 may be a digital camera device, a camera phone, smartphone or tablet utilizing a software application running on the operating system of said device to calculate the digital composite image.
Fig. 3 shows an illustration of an image representing a scene 300 with two different areas of interest 310 selected. In one example, the selected area of interest 310 of an image representing the scene 300 is defined by the user. In one example the selected at least one area of interest 310 of an image representing the scene 300 is defined based on the two pre-images. In one example the selected at least one area of interest 310 of an image representing the scene 300 is defined based on at least one facial recognition algorithm utilizing the first and/or second pre-image. In one example the selected at least one area of interest 310 of an image representing the scene 300 is defined based on the comparison between the two pre-images.
The control element may be arranged to identify at least a first area of interest 310 in the first pre-image and the second pre-image, wherein calculating the digital composite image is based also on the identified area of interest 310. The area of interest 310 may be identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
In one example, the user may select an area of interest 310 among at least one suggested area of interest 310 of an image representing the scene 300 calculated based on the comparison between the two pre-images. In one example, the selected area of interest 310 of an image representing the scene 300 is predetermined. One example of a predetermined area of interest 310 is a rectangle centred and covering 50% of the image representing the scene 300, whereby the digital composite image is calculated in order to match the desired properties in the centre of the digital composite image. The selected at least one area of interest 310 of an image representing the scene 300 may be the area of interest 310 of the digital composite image to be calculated for which the control element attempts to match the desired properties.
The control element may calculate at least one selected area of interest 310 of an image representing the scene 300. The selected at least one area of interest 310 of an image representing the scene 300 may be the area of interest 310 taken in account when calculating the digital composite image, see Fig. 3. The selected area of interest 310 of an image representing the scene 300 may instead or in addition thereto be user selected and/or automatically selected based on the first and/or second of pre-image. The control element may calculate at least one suggested area of interest 310 of an image representing the scene 300 based on the first and second pre-image for the user to select among. The control element may calculate the digital composite image so as to best achieve the at least one user desired property in at least one area of the digital composite image to be calculated, wherein at least one area of the digital composite image correlates to the at least one user selected and/or calculated area of interest 310 of an image representing the scene 300.
The user information relating to at least one desired property may comprise an area of interest of an image representing the scene 300, and wherein at least one of the at least one desired property is a desired property of the corresponding area of the digital composite image to be calculated.
The user interface may be configured to receive at least one user selection of at least one area of interest 310 of an image representing the scene 300.
The obtained user information relating to at least one desired property of the digital composite image to be calculated may relate to the whole of the digital composite image or at least one part thereof. The user information may comprise an area of interest 310 of an image representing the scene 300, wherein the area of interest 310 corresponds to an area the digital composite image to be calculated for which the control element attempts to match the at least one desired property. At least part of the user information relating to at least one desired property of the digital composite image to be calculated may be stored on the memory storage. All user information relating to desired properties of the digital composite image to be calculated may be stored on the memory storage, whereby once user information is stored the user may operate the portable electronic camera device repeatedly without inputting new user information.
The obtained user information may comprise obtaining for each area of interest 310 a first weighting value for the first pre-image, and obtaining for each area of interest 310 a second weighting value for the difference between the first pre-image and the second pre-image. Calculating the digital composite image may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of
interest 310 with the corresponding first and second weighting value. Calculating the digital composite image comprises weighting the first pre-image in areas not included in any area of interest 310 with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest 310 with a second predetermined weighting value.
Obtaining the user information may comprises obtaining for each area of interest 310 at least one amplification factor. Calculating the digital composite image may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest 310 with the corresponding amplification factor.
Obtaining the user information may comprise obtaining, for each area of interest 310, a chromaticity adjustment value. Calculating the digital composite image comprises, for each area of interest 310, adjusting chromaticity based on the corresponding chromaticity adjustment value.
Fig. 4 shows schematically a flowchart of a method according to the present disclosure. The method 400 for obtaining a digital composite image with a digital camera and an
illumination device, the method 400 comprising the steps of obtaining user information 410, obtaining a first pre-image 420 of a scene illuminated by ambient light and a flash of a first intensity, obtaining a second pre-image 430 of the scene illuminated by ambient light and a flash of a second intensity, obtaining the digital image by calculating a digital composite image 440 based on the first pre-image and the second pre-image. The step of obtaining user information 410 comprises obtaining user information relating to the calculation of the digital composite image. Calculating the digital composite image 440 is based on the user information, the first pre-image and the second pre-image.
The method may be arranged to obtain a digital composite image with the digital camera and at least two illumination devices.
The method may be arranged to obtain a digital composite image with the digital camera and the illumination device are comprised in a portable electronic camera device. The method may be arranged to obtain a digital composite image with the digital camera and the illumination device, wherein the illumination device is an external illumination device in communication with the digital camera via a communication interface.
The first or second intensity may be of zero flash intensity, as in no flash being used. In a preferred embodiment, the flash of first intensity has zero intensity.
The step of obtaining user information 410 may comprise obtaining user information comprising at least one user selected region of an image representing the scene. The user information may comprise desired properties corresponding to the selected at least one user selected region. The user selected region may be a region of special interest to the user, such as a region of an image wherein the region represents the face of a person.
The step of obtaining 410 user information may comprise user information relating to at least one desired property comprises an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
The step of obtaining a first pre-image 420 and/or obtaining a second pre-image 430 may comprise determining pre-image camera settings comprising a sensor light sensitivity setting and/or an aperture setting and/or an exposure duration setting.
The step of obtaining a first pre-image 420 and/or obtaining a second pre-image 430 may comprise determining pre-image illumination device settings comprising a mean light intensity during the exposure setting and/or a mean colour temperature setting.
The method for obtaining a digital composite image may comprise the step of identifying at least a first area of interest in the first pre-image and the second pre-image. The step of obtaining the digital image by calculating the digital composite image 440 is based also on the identified area of interest. The area of interest may be identified as being the entire first pre-image and second pre-image, based on the user information, or identified by an automatic identification process.
The step of obtaining 410 user information may comprise user information relating to at least one desired property comprising an area of interest of an image representing at least part of the scene, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated.
The step of obtaining 410 user information may comprise obtaining user information relating to at least one desired property comprising an exposure value and/or a white balance and/or a relation between luminous exposure with and without a flash.
The step of obtaining 410 user information may comprise obtaining user information relating to at least one desired property comprising an area of interest of an image representing at least part of the scene, and wherein at least one of the at least one desired property is a desired property for the corresponding area of the digital composite image to be calculated.
The step of obtaining user information 410 may comprise obtaining for each area of interest a first weighting value for the first pre-image, and obtaining for each area of interest a second weighting value for the difference between the first pre-image and the second pre image. The step of obtaining the digital image by calculating the digital composite image 440 may comprise weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest with the corresponding first and second weighting value.
Calculating the digital composite image may comprise weighting the first pre-image in areas not included in any area of interest with a first predetermined weighting value, and weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest with a second predetermined weighting value.
The step of obtaining user information 410 may comprise obtaining for each area of interest at least one amplification factor. Calculating the digital composite image 440 may comprise amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest with the corresponding amplification factor.
The step of obtaining user information 410 may comprise the step of obtaining, for each area of interest, a chromaticity adjustment value. Calculating the digital composite image may comprise, for each area of interest, adjusting chromaticity based on the corresponding chromaticity adjustment value.
The present disclosure further relates to a computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry out at least part of the presently disclosed method.
The present disclosure further relates to a computer-readable storage medium comprising instructions which, when executed by a processor, cause the processor to carry out at least part of the presently disclosed method.
The foregoing description of the preferred embodiments of the present invention is provided for illustrative and descriptive purposes. It is neither intended to be exhaustive, nor to limit the invention to the variants described. Many modifications and variations will obviously suggest themselves to one skilled in the art. The embodiments have been chosen and described in order to best explain the principles of the invention and their practical applications and thereby make it possible for one skilled in the art to understand the invention for different embodiments and with the various modifications appropriate to the intended use.

Claims

1. A portable electronic camera system for obtaining a digital image, wherein the
portable electronic camera system (100) comprises
an illumination device (160) arranged to illuminate at least part of a scene with a flash, and
an electronic camera device (110) comprising a control element (140) and a digital camera (120) arranged to capture an image of the scene,
wherein the control element (140) is arranged to communicate with the illumination device (160),
wherein the control element (140) is arranged to control the digital camera (120) and the illumination device (160),
wherein the control element (140) is arranged to
control the digital camera (120) and the illumination device (160) to obtain a first pre-image relating to the scene illuminated by ambient light and a flash of a first intensity,
control the digital camera (120) and the illumination device (160) to obtain a second pre-image relating to the scene illuminated by ambient light and a flash of a second intensity,
obtain user information relating to calculation of a digital composite image, identify at least a first area of interest (310) in the first pre-image and the second pre-image, and
obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre-image and the obtained second pre-image, wherein obtaining the user information comprises obtaining for each area of interest (310) at least one amplification factor, and
wherein calculating the digital composite image comprises amplifying the first pre-image and amplifying the difference between the first pre-image and the second pre-image in each area of interest (310) with the corresponding amplification factor.
2. The portable electronic camera system according to claim 1, wherein the user information comprises an exposure value and/or a chromaticity and/or a relation between luminous exposure with and without a flash.
3. The portable electronic camera system according to claim 1 or 2, wherein the area of interest (310) is, at least one of,
a predetermined area of interest,
based on the obtained user information, and
identified by an automatic identification process.
4. The portable electronic camera system according to any previous claim, wherein the obtained user information comprises
obtaining for each area of interest (310) a first weighting value for the first pre-image, and
obtaining for each area of interest (310) a second weighting value for the difference between the first pre-image and the second pre-image,
wherein calculating the digital composite image comprises weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest (310) with the corresponding first and second weighting value.
5. The portable electronic camera system according to any previous claim, wherein, if there exists an area not included in any area of interest (310), calculating the digital composite image comprises
weighting the first pre-image in areas not included in any area of interest (310) with a first predetermined weighting value, and
weighting the difference between the first pre-image and the second pre-image in areas not included in any area of interest (310) with a second
predetermined weighting value.
6. The portable electronic camera system according to any previous claim, wherein
obtaining the user information comprises obtaining, for each area of interest (310), a chromaticity adjustment value, and
wherein calculating the digital composite image comprises, for each area of interest (310), adjusting chromaticity based on the corresponding chromaticity adjustment value.
7. The portable electronic camera system according to any previous claim, wherein the illumination device (160) is attached to and/or comprised in the electronic camera device (110).
8. The portable electronic camera system according to claim 1-6, wherein the
illumination device (160) is separate from the electronic camera device (110), and wherein the control element (140) is arranged to communicate with the illumination device (160) via a communication interface.
9. A portable electronic camera device for obtaining a digital image, wherein the portable electronic camera device (190) comprises
a digital camera (120) arranged to capture an image of a scene, and a control element (140),
wherein the control element (140) is arranged to via a communication interface communicate with an illumination device (160) arranged to illuminate at least part of the scene with a flash,
wherein the control element (140) is arranged to control the digital camera (120) and the illumination device (160), and
wherein the control element (140) is arranged to
control the digital camera (120) and the illumination device (160) to obtain a first pre-image relating to the scene illuminated by ambient light and a flash of a first intensity,
control the digital camera (120) and the illumination device (160) to obtain a second pre-image relating to the scene illuminated by ambient light and a flash of a second intensity,
obtain user information relating to calculation of a digital composite image, identify at least a first area of interest (310) in the first pre-image and the second pre-image, and
obtain a digital image by calculating the digital composite image based on the user information, the obtained first pre-image and the obtained second pre-image, wherein obtaining the user information comprises obtaining for each area of interest (310) at least one amplification factor, and
wherein calculating the digital composite image comprises amplifying the first pre-image and/or amplifying the difference between the first pre-image and the second pre-image in each area of interest (310) with the corresponding amplification factor.
10. A method for obtaining a digital composite image with a digital camera and an
illumination device, the method (400) comprising the steps of
obtaining user information (410),
obtaining a first pre-image (420) of a scene by the digital camera illuminated by ambient light and a flash of a first intensity by the illumination device,
obtaining a second pre-image (430) of the scene by the digital camera illuminated by ambient light and a flash of a second intensity by the illumination device,
identifying at least a first area of interest (310) in the first pre-image and the second pre-image,
obtaining the digital image by calculating a digital composite image (440) based on the first pre-image and the second pre-image,
wherein the step of obtaining user information (410) comprises obtaining user information relating to the calculation of the digital composite image, and
wherein calculating the digital composite image (440) is based on the user information, the first pre-image and the second pre-image,
wherein obtaining user information (410) comprises obtaining for each area of interest (310) at least one amplification factor, and
wherein obtaining the digital image by calculating the digital composite image (440) comprises amplifying the first pre-image and/or the difference between the first pre-image and the second pre-image in each area of interest (310) with the corresponding amplification factor.
11. The method for obtaining a digital composite image according to claim 10, comprising the step of identifying at least a first area of interest (310) in the first pre-image and the second pre-image, wherein the step of obtaining the digital image by calculating the digital composite image (440) is based also on the identified area of interest (310), and wherein the area of interest (310) is
a predetermined area of interest,
based on the obtained user information, or
identified by an automatic identification process.
12. The method for obtaining a digital composite image according to claim 10 or 11,
wherein the step of obtaining user information (410) comprises
obtaining for each area of interest (310) a first weighting value for the first pre-image, and
obtaining for each area of interest (310) a second weighting value for the difference between the first pre-image and the second pre-image,
wherein the step of obtaining the digital image by calculating the digital composite image (440) comprises
weighting the first pre-image and the difference between the first pre-image and the second pre-image in each area of interest (310) with the corresponding first and second weighting value.
13. The method for obtaining a digital composite image according to claim 10 to 12,
wherein, if there exists an area not included in any area of interest (310), calculating the digital composite image comprises
weighting the first pre-image in areas not included in any area of interest (310) with a first predetermined weighting value, and
weighting the difference between the first pre-image and the second pre image in areas not included in any area of interest (310) with a second predetermined weighting value.
14. A computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry out the method (400) of any one of claims 10-13.
15. A computer-readable storage medium comprising instructions which, when executed by a processor, cause the processor to carry out the method (400) of any one of claims 10-13.
PCT/SE2020/050562 2019-06-05 2020-06-04 A portable electronic camera system, a portable electronic camera device and method for obtaining a digital image WO2020246935A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE1950675 2019-06-05
SE1950675-7 2019-06-05
SE1951288 2019-11-08
SE1951288-8 2019-11-08

Publications (1)

Publication Number Publication Date
WO2020246935A1 true WO2020246935A1 (en) 2020-12-10

Family

ID=73652049

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2020/050562 WO2020246935A1 (en) 2019-06-05 2020-06-04 A portable electronic camera system, a portable electronic camera device and method for obtaining a digital image

Country Status (1)

Country Link
WO (1) WO2020246935A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050335A1 (en) * 2004-08-05 2006-03-09 Canon Kabushiki Kaisha White balance adjustment
US20070196095A1 (en) * 2006-02-21 2007-08-23 Nokia Corporation Color balanced camera with a flash light unit
US20070201853A1 (en) * 2006-02-28 2007-08-30 Microsoft Corporation Adaptive Processing For Images Captured With Flash
US20150063694A1 (en) * 2013-08-30 2015-03-05 Qualcomm Incorporated Techniques for combining images with varying brightness degrees
US20160071289A1 (en) * 2014-09-10 2016-03-10 Morpho, Inc. Image composition device, image composition method, and recording medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050335A1 (en) * 2004-08-05 2006-03-09 Canon Kabushiki Kaisha White balance adjustment
US20070196095A1 (en) * 2006-02-21 2007-08-23 Nokia Corporation Color balanced camera with a flash light unit
US20070201853A1 (en) * 2006-02-28 2007-08-30 Microsoft Corporation Adaptive Processing For Images Captured With Flash
US20150063694A1 (en) * 2013-08-30 2015-03-05 Qualcomm Incorporated Techniques for combining images with varying brightness degrees
US20160071289A1 (en) * 2014-09-10 2016-03-10 Morpho, Inc. Image composition device, image composition method, and recording medium

Similar Documents

Publication Publication Date Title
KR101570772B1 (en) Image capture apparatus, display control method, and storage medium
JP4149467B2 (en) How to adjust camera exposure
US8922669B2 (en) Image processing apparatus having a display unit and image processing program for controlling the display unit
CN105959581A (en) Electronic device having dynamically controlled flashlight for image capturing and related control method
US8922673B2 (en) Color correction of digital color image
US20220053121A1 (en) A method, software product, camera device and system for determining artificial lighting and camera settings
KR20120038721A (en) Digital image processing apparatus and digital image processing method
JP2015130615A (en) Imaging device, control method of the same, and program
TWI505233B (en) Image processing method and image processing device
KR20200017271A (en) An elelctronic device and method for processing an image in the same
CN111492653B (en) Method and device for quickly adjusting white balance of camera and computer readable storage medium
CN104980647A (en) Image processing apparatus, imaging apparatus, determination method and driving method
CN114257738A (en) Automatic exposure method, device, equipment and storage medium
CN104394329B (en) A kind of photographic method, device and mobile terminal
US11120533B2 (en) Information processing method and information processing apparatus
JP7103839B2 (en) Electronic devices, control devices, control methods and control programs
JP2015034850A (en) Photographing device and photographing method
JP2023059952A (en) Image processing device, imaging device, image processing method, image processing program, and recording medium
JP2021153229A (en) Information processing apparatus, imaging apparatus, method, program, and storage medium
WO2020246935A1 (en) A portable electronic camera system, a portable electronic camera device and method for obtaining a digital image
JP2012155044A (en) Electronic camera
KR20130011201A (en) Apparatus and method for adjusting auto focus in image taking device
US10409141B2 (en) System and method for improved camera flash
JP2017153045A (en) Image processing apparatus, imaging apparatus, and control method and program for the same
KR20100009967A (en) Method of controlling white balance at flashlight photographing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20817980

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20817980

Country of ref document: EP

Kind code of ref document: A1