WO2018219733A1

WO2018219733A1 - A lighting system and a method of blending visual content with lighting

Info

Publication number: WO2018219733A1
Application number: PCT/EP2018/063489
Authority: WO
Inventors: Olexandr Valentynovych VDOVIN; Hendrik Johannes Boudewijn Jagt; Bas BATENBURG; Dirk Kornelis Gerhardus De Boer; Albert Bijlsma; Christoph Gerard August HOELEN; Dominique Maria Bruls; Roelof Koole; Daniël Anton BENOY
Original assignee: Philips Lighting Holding B.V.
Priority date: 2017-05-29
Filing date: 2018-05-23
Publication date: 2018-12-06

Abstract

A lighting-system (100) for blending a visual content with light comprising a projecting device (111) for projecting the visual content on at least one display area (141), at least one light source (151) for emitting the light and illuminating at least partially the display area (141) and at least a lighting area (142) adjacent the display area (141) and a light- intensity filter for filtering a light intensity of the visual content. The light-intensity filter 5 (121) is configured for gradually reducing the light intensity of the projected visual content (118) from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

Description

A lighting system and a method of blending visual content with lighting

FIELD OF THE INVENTION

The invention relates to a lighting-system, an integrated lighting system device comprising the lighting-system and a method of blending a visual content with light.

BACKGROUND

Lighting-system combining projection of visual content, for example, still images or video content, with ambient lighting is known in the art. Merging ambient lighting and projection functions can create new user experience of immersive projection and atmosphere creation.

Some realizations of such lighting-systems are described in patent applications US2010/0110387A1 and US 2012/0262072A1.

US2010/0110387A1 describes a method of controlling a room in accordance with a still or moving image projected onto a projection surface and a system for controlling the lighting of the room. The lighting of the room is adjusted on the basis of optically measuring a number of characteristic features of the projected image, for example luminous intensity and/or color values. Measuring the characteristic features is performed on the projected image by for example using a number of optical sensors.

US 2012/0262072A1 describes a method for providing an ambience light effect in a cinema comprising a cinema display screen arranged on a front wall of the cinema and a plurality of light sources comprising receiving first and second image content to be sequentially displayed on the cinema display screen, determining at least one of a color and intensity for the second image content, determining a second set of control data for controlling the plurality of light sources to emit an ambient light effect based on at least one of the color and intensity for the second image content, and associating the second set of control data with the first set of image content. Thus, for example, in a practical example described in US 2012/0262072A1, a plurality of light sources may be installed on the side walls of the cinema which may be activated in function of an image to be displayed on the cinema screen. For example, a colored car approaches from the left-hand side of the cinema display screen and moves towards the right end side of the cinema display screen. When the car is not yet shown on the display screen, a selective set of the plurality of light sources arranged on the left-hand side of the cinema display screen will emit a color matching the color of the car. When the car is shown on the cinema display screen, none or only a small set of the plurality of light sources may be activated with a matching color. When the car is once again not shown on the cinema display screen, a selective set of the plurality of light sources arranged this time on the right-hand side of the cinema display screen will emit a color matching the color of the car.

By using and illuminating an extra space of an area surrounding the projection surface as in US2010/0110387A1 or the side walls of a cinema as in US 2012/0262072A1, the observer has an improved, more immersive viewing experience compared to systems not making use of the ambience light.

However, with any of these prior art methods, an observer of the projected image would still be able to distinguish between an ambience light made up by one or more light sources and an image projected on the display screen by a projector. In other words, the observer sees the ambience light and the projected image as two separate visual effects. Since these two separate visual effects are clearly distinguishable in the eye of the observer, the observer cannot really have an immersive augmented visual perception of the projected image. SUMMARY OF THE INVENTION

It would be advantageous to have an improved lighting-system giving a better immersive augmented visual perception to an observer of a projected visual content.

A lighting-system for blending a visual content with light is provided. The lighting-system comprises:

- a projecting device for projecting the visual content on at least one display area,

at least one light source for emitting the light and illuminating at least partially the display area and at least a lighting area adjacent the display area, and

a light-intensity filter for filtering a light intensity of the visual content.

The light-intensity filter is configured for gradually reducing the light intensity of the projected visual content from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area. In this way, sharp transitions of the projected visual content between the display area and the lighting area disappear, giving to the observer the perception of a seamless transition between the display area and the lighting area without any sharp edges in between. The observer is fully immersed in the projected visual content. The visual content becomes indistinguishable from the ambience light emitted by the light source. The projected visual content has no sharp edges but it is continuously blended with the ambience light.

The sharp transition visible in prior art systems, is a consequence of a light intensity step that usually occurs at the edges of the display area. This gives the impression of a projected display area with sharp edges, usually of rectangular form. By using the light- intensity filter, this light-intensity step is smoothened out across the display area and the lighting area such that sharp edges between the display area and the lighting area

substantially disappear.

US2012/242251A1 discloses an ambience lighting system, typically for use in conjunction with a display device. The ambience lighting system comprises one or more light sources associated to subregions of the display screen, a content characterizer for determining content characteristics of image data of the sub-regions, and a controller to control the color of the emitted ambience light in accordance with determined content characteristics. The content characterizer is further adapted to determine content characteristics of a global region of the display screen, and the controller is adapted to control the color of the emitted ambience light in accordance with the determined content characteristics of the subregions and of the global region.

US2011/242684A1 discloses a filter, to be disposed concentrically with an optical axis of an imaging lens, capable of accurately controlling light transmission variation characteristics and effectively providing an apodization effect or a peripheral light intensity correction effect. The filter includes opaque dots disposed according to a honeycomb arrangement from a central portion toward a peripheral portion so as to have, at least partially, a Gaussian distribution like dot density.

US6611297B1 discloses an illumination control method of the present invention, wherein illumination of an appreciation space is controlled in association with an image displayed on an image display device so that a realism of the image displayed on a screen of the image display device can be enhanced, where an appreciator appreciating the image is in the appreciation space. More specifically, one or more light sources provided in the appreciation space is controlled so that at least one parameter of a level, a light color, a luminous intensity distribution, and a direction of illumination to the appreciation space is made substantially coincident with a corresponding parameter of a virtual image space imaginarily created from the image displayed on the image display device.

In an embodiment, the light-intensity filter is configured for gradually changing the color of the projected visual content from the display area towards the lighting area for a smooth color transition between the display area and the lighting area.

To further enhance blending of the visual content with light, a color matching of the color of the display area and the color of the lighting area is provided to obtain a smooth color transition. For example, a dominant color of the display area may be used to this purpose. This color matching can be performed at multiple localized areas within the transition areas between the display area and the lighting area.

An observer of the blended visual content sees no color effects or hues in the transition between the display area and the lighting area. The viewing experience of the observer is thus further improved. For example, the light-intensity filter has different light color profiles correlated to a color of the light for obtaining a smooth color transition of the visual content between the display area and the lighting area.

Thus, besides filtering intensity of light, the light-intensity filter may be provided with different color profiles to filters colors in the visual content and providing a smooth color transition between the display area and the lighting area.

In an embodiment, the light-intensity filter is a hardware filter or a digital filter. For example, a hardware filter may be arranged within an optical path of the projecting device to provide the desired light intensity distribution profile.

In an embodiment, the hardware filter may comprise a light-intensity neutral filter.

In an embodiment, the hardware filter may comprise one central opening at a central part of the filter corresponding to the display area and a plurality of openings smaller than the central opening at another part of the filter corresponding to an edge of the display area with the lighting area for partially transmitting light at an edge of the central opening.

In an embodiment, the hardware filter may comprise a substrate transparent to light at a part of the substrate corresponding to the display area and gradually more opaque to light or gradually more scattering light at another part of the substrate corresponding to an edge of the display area with the lighting area.

In an embodiment, the hardware filter may comprise a lens having a predefined shape for reducing light intensity of the projected visual content from the display area towards the display area. In an embodiment, the light-intensity filter is arranged to provide the visual content with a light intensity distribution profile from a center of the display area or from an area between the center of the display area and an edge of the display area with the lighting area, towards the lighting area, of a half-parabolic, half-cosine, half-Gaussian or half- Lorentzian shape Parabolic, cosine , Gaussian or Lorentzian light-intensity distribution profiles provide light intensity of the visual content which is gradually decreasing towards the lighting areas and thus provide smoother transitions between the display area and the lighting area.

In an embodiment, the light-intensity filter is arranged to provide a light intensity- filtered visual content having a spatial distribution of an elliptical, circular, square or rectangular or any other shape suitable for the specific implementation.

In an embodiment, lighting-system further comprises a programmable controller configured to control a light intensity of the at least one light source, and a lighting-system control device comprising a processor circuit. The processor circuit is configured to determine lighting control data to change the light intensity of the light source based on a light intensity of the visual content, in addition to gradually reducing the light intensity of the projected visual content, such that the blended visual content has a light intensity gradually reducing from the display area towards the lighting area. The processor circuit is configured to transmit the lighting control data to the programmable controller.

For example, the light intensity of the at least one light source may be changed such the light intensity of the light source at a transition area between the display area and the lighting area exceeds the light intensity of the projected visual content in the same transition area. The light intensity of the at least one light source may for example be decreased from the lighting area towards the display area for providing a seamless blending of the projected visual content with light.

Another aspect of the invention provides an integrated device comprising the lighting system. Thus the light source, the light-intensity filter and the projecting device may be integrated in an integrated lighting system device. Such a device may be a portable integrated lighting system device, for example an integrated digital light processing (DLP) projector. Lighting-system may thus be more portable and practical to use.

Another aspect of the invention provides a method of blending a visual content with light. The method comprises:

projecting the visual content on at least one display area, illuminating at least partially the display area and at least a lighting area adjacent the display area,

gradually reducing the light intensity of the projected visual content from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

The method according to the invention may be implemented on a computer as a computer implemented method, or in dedicated hardware, or in a combination of both. Executable code for a method according to the invention may be stored on a computer program product. Examples of computer program products include memory devices, optical storage devices, integrated circuits, servers, online software, etc.

The computer program product may comprise non-transitory program code stored on a computer readable medium for performing a method according to the invention when said program product is executed on a computer.

The computer program may comprise computer program code adapted to perform all the steps of a method according to the invention when the computer program is run on a computer. The computer program may be embodied on a computer readable medium. BRIEF DESCRIPTION OF THE DRAWINGS

Further details, aspects, and embodiments of the invention will be described, by way of example only, with reference to the drawings. Elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. In the Figures, elements which correspond to elements already described may have the same reference numerals. In the drawings,

Fig. la schematically shows an example of an embodiment of a lighting- system,

Fig, lb schematically shows an example of an embodiment of a lighting- system,

Fig, lc schematically shows an example of an embodiment of a lighting- system,

Fig. Id schematically shows an example of an embodiment of a light source, Fig. 2 schematically shows an example of an embodiment of an integrated lighting system device, Fig. 2a schematically shows an example of light-intensity unfiltered visual content distribution profiles,

Fig. 2b schematically shows an example of light-intensity filter distribution profiles,

Fig. 2c schematically shows an example of light-intensity filter distribution profiles and their respective visual effects on the visual content,

Fig. 2d schematically shows an example of a projected visual content blended with light according to an embodiment of the invention,

Fig. 3 a schematically shows an example of an embodiment of a lighting- system,

Fig. 3b schematically shows an example of an embodiment of a lighting- system,

Fig. 3 c schematically shows an example of an embodiment of a lighting- system,

Fig. 4a schematically shows an example of an embodiment of a device,

Fig. 4b schematically shows an example of an embodiment of a device, Fig. 4c schematically shows an example of an embodiment of a device, Fig. 4d schematically shows an example of an embodiment of a device, Fig. 5 schematically shows flow diagram for a method of blending a visual content with light,

Fig. 6a schematically shows a computer readable medium having a writable part comprising a computer program according to an embodiment,

Fig. 6b schematically shows a representation of a processor system according to an embodiment.

List of Reference Numerals in figures la-4d:

100-105 a lighting-system

107 an input visual content

108 a projected visual content

111-113 a projecting device

114-118 an integrated lighting system device

121 a light-intensity filter

122 a controller

123, 133 a network interface 124 a processor

130 a lighting-system control device

132 a processor circuit

140 a projection lens

145, 147 an additional optical element

141 a display area

142 a lighting area

144 an area of interest

146 a screen

149, 151 a light source

152 a programmable controller

153 a further light source

155 a digital mirror display

156 an optical element

157 an integrator rod

158 a light beam

159 a transparent emitter

160 a non-transparent light source

161 a white led

162 a red led

163 a blue led

164 a green led

165, 167 a single light source

169 ambient light

170 a set of lenses

171-174 a mirror

176 color tuning

177 an aperture

180-183 a light-intensity unfiltered visual content distribution profile 200 a media device

210, 220-250 a light-intensity filter distribution profile

201 a storage

R red light

G green light B blue light

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

While this invention is susceptible of embodiment in many different forms, there are shown in the drawings and will herein be described in detail one or more specific embodiments, with the understanding that the present disclosure is to be considered as exemplary of the principles of the invention and not intended to limit the invention to the specific embodiments shown and described.

In the following, for the sake of understanding, elements of embodiments are described in operation. However, it will be apparent that the respective elements are arranged to perform the functions being described as performed by them.

Figure la schematically shows an example of an embodiment of a lighting system 100.

Lighting-system 100 is configured to blend a visual content to be projected on a display area 141 with light filling at least partially display area 141, and a lighting area 142 adjacent to the display area 141. Lighting-system 100 may be used to show static or dynamic visual content, e.g. text, still images or video content, on a display screen or any suitable surface such as a wall, a ceiling or a floor. Lighting-system 100 may be find practical applications for private use such as for home lighting-systems, for professional use such as for office lighting-systems or cinema projectors or for commercial use such as for lighting- systems used in retail shops or shopping malls or in outdoor applications, for instance in city beautification or in advertisements on buildings.

Lighting system 100 comprises a projecting device 111, a light source 151, and a light-intensity filter 121. Light-intensity filter 121 may be optionally integrated in a media device 200 comprising also a storage 201 for storing the visual content to be projected.

Projecting device 111 may be a slide projector, or more commonly a video projector, a movie projector or digital cinema video projectors. Projecting devices comprise an internal light source for generating light used for projection, a digital display device for generation of the visual content and a projecting lens through which light for projecting the visual content passes and focuses on the display area.

Light-intensity filter 121 is configured for filtering a light intensity of the visual content. Light-intensity filter 121 is configured for gradually reducing the light intensity of the projected visual content from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

In an embodiment, light-intensity filter 121 is configured for gradually changing color from the display area towards the lighting area for a smooth color transition between the display area and the lighting area.

Media device 200 may for example be a personal computer, a mobile phone, a tablet, a streaming device, storing input visual content 107 in storage 201 and capable to transmit filtered input visual content to projecting device 111.

Storage 201 may be for example a memory, a hard drive or a database storing input visual content 107 or a connection to an online storage, such as a storage in the cloud or a storage on an internet webpage.

Projecting device 111 may be wired or wireless connected to a network of devices and media device 200 may be one of such devices. Projecting device 111 may comprise an input interface (not shown in Figure la) to connect to media device 200 or directly to storage 201 if light-intensity filter 121 is integrated in the projecting device as shown later.

In an embodiment, media device 200 is wired or wireless coupled to projecting device 111 via for example a network interface.

In another embodiment, the media device may be integrated in the projecting device.

In an embodiment, a hardware or digital light intensity filter may be used to reduce the light intensity and/or to change the color.

As shown later, the hardware filter may be integrated in the projecting lens or arranged within an optical path of the projecting device.

A digital filter may be for example implemented by a CPU or dedicated image or video processor having suitable software running therein. The image or video processor may be integrated with the media device, the projecting device or in any other suitable devices of the lighting-system.

Light source 151 is configured to emit light and illuminate at least partially display area 141 and lighting area 142. Light generated by light source 151 is used as ambient or ambience light. Such light fills at least partially the display area and the adjacent lighting area providing the observer with an enhanced viewing experience.

Display area 141 and lighting area 142 may be part of a cinema display screen, home or office display screen, a wall, a floor, or a ceiling or a building. The display and lighting area may be on a substantially flat surface or on a textured surface, a surface with relief or a 3D shaped surface of an object or subject or a combination thereof. Part of the display or lighting area may be located on a different surface type or may be provided at a different depth. For instance, part of the lighting area may be on wall and part of the lighting area and the display area may be on an object placed in front of the wall. Hence, the lighting area and display area may be a projected area and not necessarily be arranged on the same surface over the total area. Furthermore, the lighting area may be generated by multiple light sources that are part of the lighting system. Not all of these light sources may be used to provide the blending effect with the display area. For instance, part of the light sources may be used to illuminate a room and part of the light sources may be used to at least partially overlap the light generated therefrom with the display area. The display area on which the visual content is projected may be of any shape, for example rectangular, square. In the embodiment shown in Figure la, lighting area 142 is surrounding display area 141. However, other alternative configurations are possible. For example, the lighting area may be adjacent to the display area only at the bottom, top, lateral sides of the display area, at specific areas of interest of the display area or at a combination of locations thereof. Furthermore, multiple display areas may be present surrounded by a multitude of partially overlapping lighting areas.

Blending the visual content with light may thus be provided at one or multiple sides of the display area for a better seamless visual effect in one or more transitions between the display area and the lighting area.

It is noted that in conventional prior-art projectors the projected content has a well-defined shape, for example rectangular, square. In conventional prior-art projectors the format of the projected content is determined by the particular format with which the projector is able to project.

In the invention, because of the light-intensity filtering, the visual content projected on the display area is blending with, or in an ideal case undistinguishable from, the light illuminating the lighting area adjacent the display area. Thus, when an observer sees the projected visual content, he sees only one image without edges between the display area and the lighting area. The projected visual content and the light compose a scene which is observed as one area wherein the projected visual content becomes integral part of the lighting area.

Figure lb schematically shows an example of an embodiment of a lighting system 101. Lighting system 101 comprises a projecting device 112, light source 151 and an optional storage 201. Lighting-system 101 differs from lighting-system 100 in that projecting device 112 comprises a light-intensity filter 121. Light-intensity filter 121 is thus integrated in projecting device 112 and not in an external media device.

Light-intensity filter 121 is configured to filter a light intensity of input visual content 107. Light-intensity filter is configured for gradually reducing the light intensity of the projected visual content from display area 141 towards lighting area 142 for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between display area 141 and the lighting area 142.

In an embodiment, light-intensity filter 121 is a hardware filter, for example mounted on top of the projection lens. Light-intensity filter 121 may be for example a neutral-density filter that reduces or modifies the intensity of all wavelengths or colors of light equally but with an increasing degree towards the edges of the display area.

In an embodiment, the hardware filter comprises a diaphragm or aperture, for instance a round aperture or an elliptical aperture. The aperture of diaphragm may have a control mechanism to widen or close the opening, for instance with a manual or motorized digital control. The filter edges are preferably out of focus such as to blur the content edges.

In an embodiment, the hardware filter may be an aperture with a central opening and a multitude of small openings, such as holes near the edges. The holes are arranged such that the edge of the aperture opening is partially transmitting light to reduce a sharp cut-off between the central opening and the aperture edge. More holes or wider holes may be present near the aperture central opening than further away from the central opening. The blurred projection of light through these holes prevents a sharp image of the holes but allows a transition area at the edges of the opening with a reducing intensity.

In an embodiment the hardware filter may comprise a transparent substrate, for instance a glass plate that is locally scattering light. The glass plate may comprise a transparent glass at central area of the display and a gradually more scattering glass at an area of display towards the lighting area. The scattering may be caused by a surface scattering, such as a surface roughness, and/or by a volume scattering, such as from scattering particles in or on the substrate. The scattering glass may hence form a halo such as to filter the projected content in reducing the amount of light that is projected on the display area at the areas of transition to the lighting area.

In an embodiment, the hardware filter may comprise a shaped lens or free- form lens, such as to deform or distort the visual content at the areas of transition to the light source area, i.e. the lighting area when the light source is projected, causing a light spreading effect, reducing the intensity. The lens may be partially scattering, in a similar way as the glass substrate embodiment.

The hardware filter may is arranged within the optical path of the at least one projecting device, e.g. between the display and the projection lens or in front of the projection lens.

In an embodiment, light-intensity filter 121 is a digital filter. For example, specific software may run in a processor to digitally filter the light intensity of the visual content. The digital filtering may be done real-time by the processor. Alternatively, the visual content may be pre-filtered and stored before sending the pre-filtered visual content data to the projecting device.

In an embodiment, light-intensity filter 121 has different light color profiles correlated to a color of the light for obtaining a smooth color transition of the visual content between the display area and the lighting area. Thus besides light intensity, color may be used to blend the visual content with the light.

In an embodiment, the color of light may be matching the color of the visual content in one or more specific point or parts of the display area. For example, the color of the light may be matching the color at the edge of the display area or at specific area of interest of the displayed visual content. Color blending of the visual content is performed in the filtered part of the display area where the light-intensity is reduced towards the lighting area. Color blending and color matching may be performed such that no color effects such as hues are visible on the projected visual content. For example, if the color of the visual content to be matched at the edge of the display area is green and the color of the light overlapping the edge of the display area is red, a yellow color would be obtained in the edge part of the display area by simply overlapping the projected visual content and the ambient light. This is undesired because an abrupt color transition would be visible. In this case, it preferable to use a filter with a green or orange color profile at the edge of the visual content to provide a smoother color transition between the display area and the lighting area.

In an embodiment shown later, the light-intensity filter is arranged to provide the visual content with a light intensity distribution profile from a center of the display area or from an area between the center of the display area and an edge of the display area with the lighting area, towards the lighting area, of a half-parabolic, half-cosine, half-Gaussian or half-Lorentzian shape.

In an embodiment, the light-intensity filter is arranged to provide a light intensity- filtered visual content having a spatial distribution of an elliptical, circular, rectangular or square shape. Rectangular or square shapes may provide larger area for projecting the content.

However, the shape of the spatial distribution is not limited to any specific shape. The shape may be of any type suitable for the specific implementation as far as the light intensity from the display area towards edges of the display area with the lighting area is reduced to a sufficient extent for providing the desired blending effect of the visual content with the ambient light.

Figure lc schematically shows an example of an embodiment of a lighting- system 102. Lighting-system 102 comprises a projecting device 113, light source 151, storage 201 and a lighting-system control device 130.

Projecting device 113 may further comprise a controller 122 configured to control an operation of projecting device 113 and a network interface 123 configured to allow projecting device 113 to communicate via a digital network, with for example light source

151 and/or storage 201. Digital network can be wired or wireless.

In an embodiment, lighting system 102 comprise a programmable controller

152 configured to control a light intensity of light source 151, and a lighting- system control device 130. Lighting-system control device 130 comprises a processor circuit 132 and a network interface 133. Network interface 133 is configured to allow lighting-system control device 130 to communicate via a digital network, with for example light source 151 and projecting device 113. Processor 132 is configured to determine lighting control data to change the light intensity of light source 151 based on a light intensity of the filtered visual content, e.g. received from the projecting device 113 via corresponding network interfaces 123 and 133 such that the blended visual content has a light intensity gradually reducing from the display area towards the lighting area, i.e. towards edges of the display area. Process circuit 132 transmits the lighting control data to the programmable controller 152 for programming the programmable controller according to the lighting control data.

In an embodiment, processor 132 is configured to determine lighting control data such that the light intensity of the light source at a transition area between the display area and the lighting area exceeds the light intensity of the projected visual content in the transition area.

In an embodiment, the light intensity of the at least one light source at a transition area between the display area and the lighting area exceeds the light intensity of the projected visual content in the transition area by more than 2, preferably 5 or preferably 10 times. The light intensity of the at least one light source may for example be decreased from the lighting area towards the display area for providing a seamless blending of the projected visual content with light.

Controller 122 may further comprise a processor 124 for processing the input visual content before the visual content is projected through the projecting lens. However, processor 124 may also be integrated in the lighting-system control device 130 or the storage device 201.

When using a digital filter, processor 124 is configured to digitally filter the light-intensity of the visual content such that the light-intensity of the visual content is reduced from the display area to the lighting area and an observer sees an edgeless transition between display area and the lighting area.

In an embodiment, processor 124 is configured to determine a color from the visual content, and determine color control data to adapt a light spectrum of the light source and/or the visual content in a portion of the display area where the light-intensity is reduced.

In an embodiment, processor 124 is configured to determine the color in an area of interest 144 of the visual content. Color control data is determined from the color in the area of interest 144.

For example, the area of interest 144 may comprise a colored object, text or subject in the visual content that one would like to highlight with an ambient light of similar color.

In an embodiment, the color of the ambient light may be uncorrected to any color shown in the visual content. For example, a special atmosphere based on a particular theme shown in the visual content would like to be created in which case processor circuit 132 is configured to predetermine the color of the light sources based on a desired visual effect to be achieved. However, even in the latter embodiment, the light-intensity and the color of the light source are adapted to provide a smooth transition between the display area and the lighting area.

Processor 124 may be configured to digitally filter the color of the visual content such that a smooth color transition is obtained between the display area and the lighting area.

In an embodiment, processor 124 may receive via network interface 123 light source color data from the lighting-system control device 130 and determine corresponding color control data to adapt the light spectrum of the visual content for obtaining a smooth color transition between the display area and the lighting area. In an embodiment, processor 124 may transmit via network interface 123 the color control data to lighting-system control device 130. Processor circuit 132 may then determine lighting color control data to program programmable controller 152 and control the light spectrum of the light source 151 for obtaining a smooth color transition between the display area and the lighting area.

The controller 122 controls functionality of the projecting device 113, for example turns projecting device 113 on or off. Controller 122 may regulate color and/or luminosity of input visual content 107 via the processor 124.

In an embodiment, controller 122 is configured to turn-off the projecting device 113 and transmit this information to lighting-system control device 130 via the network interface 123. When the projecting device 113 is turned off, processor circuit 132 of lighting-system control device 130 may be configured to determine lighting control data only for illuminating the environment. Processor circuit 132 may be configured to transmit such lighting control data to programmable controller 152 for programming programmable controller 152 accordingly. In this embodiment, light source 151 can be operated as an ambient light for illuminating the environment and not as filling light for the projected visual content. Thus lighting-system 102 may be used as a lighting system for illuminating the environment when the projecting device is turned off and as a lighting-system for blending the visual content with light when the projecting device is turned on. Furthermore the lighting-system 102 may also be used as a regular projecting device when light source 151 is switched off. Lighting-system 102 may therefore have multiple modes of operation: as a lighting system, as a projecting system and as a blending system of lighting and projection.

Light source 151 may be of any type for which the light intensity, light color and/or light spectrum can be changed through a programmable controller and is suitable for the specific implementation.

In an embodiment, light source 151 comprises one or more solid state light emitters. Examples of solid state light emitters are Light Emitting Diodes (LEDs), Organic Light Emitting diode(s) OLEDs, or, for example, laser diodes.

In some embodiments the solid state light emitter may be a blue light emitting LED, such as GaN or InGaN based LED, for example emitting primary light of the wavelength range from 440 to 460 nm. Alternatively, the solid state light source may emit blue, UV or violet light which is subsequently converted into light of longer wavelength(s) by one or more wavelength converting materials. Nevertheless, the LED might also be a direct phosphor converted LED. For instance, a pc-LED having a CCT of 2300K up to 20,000K can be used.

In some embodiments the light source 151 may consist of various individual LED light sources, preferably color controllable, such as RGB or RGBW spot lamps, such as GUI 0 or MR16 lamps, RGB or RGBW LED bulbs, RGB or RGBW PAR lamps, RGB or RGBW downlights, RGB or RGBW LED strips, RGB or RGBW linear light sources, RGB or RGBW entertainment lights and the like. Such LED light sources may contain one RGB or RGBW unit cell or a multitude of RGB or RGBW unit cells. The unit cells may be individually and/or collectively controllable in color depending on the current ratios between the red, green, blue and white LEDs. The LED lamps may contain a suitable optic or be placed in a luminaire that contains a suitable optics, such as for instance to direct the light in the proper direction, for instance by using reflectors optics, TIR optics, lenses and the like. The LED lamps may wirelessly controllable such as the Philips Hue lamps, for instance, Philips Hue GUlO spots, Philips Hue bulbs, Philips Hue PAR or Philips Hue LED strips. The various light sources may be used and powered individually or be integrated into a joint luminaire or integrated in various luminaires. Various types of light sources may be mixed within one lighting- system solution. The light sources may be directed towards different parts of the lighting area and placed such as to be positioned at different locations with respect to the display area. As such, an optimal intensity and color distribution with respect to the display area can be tuned.

Other light sources may be used as well, for example, fluorescent light bulbs, tungsten-halogen light, or the like. The light sources may contain filters to color the light of a white light generating source, such as a halogen or xenon source. The filters may be electronically controllable to change the color via a digital command. Such light sources may be entertainment spots, for instance a Gobo spot.

In an embodiment, the light source is a LED source arranged to have a controllable light spectrum. In an embodiment, the light source is of a type in which the spectrum is changed by changing the color temperature.

Figure Id schematically shows an example of an embodiment of a light source 151.

Light source 151 may comprise a lighting emitting diode (LED) source. LED source 151 comprises four different color LEDs: a white led 161, a red led 162, a blue led 163 and a green LED 164, also called RGBW LED. LED source 151 is a four-channel lighting element, i.e. having four-channels for driving the LED source 151. Lighting control data for LED source 151 has four channels, one for each LED.

Depending on the determined lighting control data or color control data, one or more of the LEDs 161, 162, 163 or 164 may be selectively switched on or off or dimmed to change the light intensity or light spectrum of LED source 151. In an embodiment, light or color intensity of the LEDs 161, 162, 163 or 164 may be selectively increased or decreased to change the light intensity and/or light spectrum of LED source 151. The optics of the LEDs may be shared such as to direct and mix the light in the far field, or the LEDs may have individual optics to direct the light. The optics may include reflectors, TIR collimators, lenses and the like.

In an embodiment, each LED 161, 162, 163 or 164 has a spectrum within a wavelength range of the corresponding color. For example, red led 161 may have a spectrum within the wavelength range of red color, e.g., within the range 630-680 nm.

Similarly, blue led 163 may have a spectrum within the wavelength range of blue color, e.g., within the range 440-505 nm. The white LED 161 and the green LED 164 may have, similarly, a spectrum within the wavelength range of the respective white and green color.

In an embodiment, the color of the light source 151 may be adapted such that a smoother color transition between the display area and the lighting area is obtained.

In an embodiment, the light source is embedded in the display area and the lighting area. For example, the display area and lighting area may be part of an active display, for example a LCD screen or the like. The active display may comprise one or more of the light emitter described above.

Figure 2 schematically shows an example of an embodiment of an integrated lighting system device 114, e.g. integrated in a digital light processing (DLP) projector. Integrated lighting system device 114 comprises a projection lens 140 through which the visual content is projected and an illumination system 150 comprising a further light source 153 for generating the light for projecting the visual content.

In one embodiment shown later, the light source and the further light source are a single light source from which light may be generated for projecting both the visual content and the ambient light.

Integrated lighting system device 114 may further comprise all or most components of lighting-system 102 shown with reference to Figure lc: light-intensity filter 121, controller 122 and processor 124, lighting-system control device 130 and processor circuit 132, light source 151 and programmable controller 152.

Lighting-system 100, 101 or 102 may be thus be integrated in a single device, making the lighting-system lighter and more portable and more easy to set-up and install.

Figure 2a schematically shows a graph of different light-intensity unfiltered visual content distribution profiles 180-183. Profiles 180-183 show how the light intensity may change natively in a projected visual content, i.e. without applying the light-intensity filter of the invention.

In the vertical axis of the graph, light intensity levels increasing from bottom to top of the graph are indicated. The visual content may comprise projected images or videos. These projected images or videos comprise a certain number of digital pixels. The horizontal axis of the graph shown in Figure 2a, indicates, from left to right, an increasing number of pixels for the image or video projected in one directional cross-section. This cross- section includes the entire area on which the visual content is displayed, shown in this example without applying the light-intensity filter and without applying a filling ambient light.

Profile 180 is an example of unfiltered visual content with uniform light intensity across the display area and the lighting area.

Profile 181 is an example of unfiltered visual content with an increasing intensity from center to edges.

Profile 182 is an example of unfiltered visual content with an irregular light intensity pattern.

Profile 183 is an example of unfiltered visual content with a decreasing light intensity pattern towards the edges.

The sharp transition of profile 183 may be part of a bright logo or text or object within the cross-section of analysis. Profile 183 is an example of desired light intensity distribution profile which may only require limited additional light intensity filtering or no filtering at all.

Figure 2b schematically shows a graph of different light-intensity filter distribution profiles 210-250. Profile 210 is linear, i.e. light intensity level decreases linearly from a center of the display area towards an edge of the display area or the adjacent lighting area (not shown in Figure 2b).

Profile 220 is parabolic, i.e. light intensity decreases with a parabolic shape from the center of the display area. With Profile 230, light intensity remains constant from the center of the display area to an area between the center of the display area and the edge of the display area and then starts to decreases also with a parabolic shape.

The light-intensity filter may be configured to filter the light intensity of the visual content with any of the profile 210-250 or any mixture of profiles 210-250 or any similar profiles. Profile 220, 230, 250 having an increasing slope towards the edge are preferred than profiles having a constant slope because provide a smoother transition between the display area and the lighting area. The profiles shown in Figure 2b provide a projected visual content with a gradually decreasing light intensity towards the edge of the display area. The light intensity may decline to zero or nearly zero but may also go to a higher level as long as the light-intensity level provided by the filter profile is lower than the level of the lighting provided by the light source at the location of overlap. Preferably the level of the lighting provided by the light source is substantially higher than the light level provided by the filter profile, i.e. of the projected visual content, at the edges of the display area. The level of the lighting at the location of overlap between the display area and the lighting area consists not only of the light generated from light source 151 but may also in part consist of an ambient light level, for instance, daylight entering a room via a window or a background light level from the lighting system of a room.

In an embodiment, corresponding to profile 240, light-intensity may decrease to a low intensity level different from zero at positions deviating from the edges, such as the first and last pixels, i.e. pixel 0 and pixel 2000 in Figure 2b. For instance, profile 240 goes down to a low intensity at pixel numbers 200 and 1700 and flattens out at the left side towards pixel number 0 and at the right side towards pixel number 2000.

In another embodiment, corresponding to profile 250, light-intensity may decrease to a zero light-intensity level at positions deviating from the edges. As shown, in profile 250 the light intensity decreases to zero approximatively at pixel numbers 300 and 1700 and remains zero until the edges.

It is therefore not required to use filter profiles which have a decreasing light intensity across the full transition area available for displaying the visual content and projecting the ambient light.

When a digital filter is used, and in cases where the unfiltered visual content has inherently smooth transitions to low intensity levels toward the edges of the display area, smart image analysis algorithms may be used to provide less filtering of the light intensity or no filtering at all. In addition, the area covered by the projector may be made quite large. Sub- regions of the projected area may be used to display different content. The filtering may also be applied to these sub-regions in order to obtain a smooth transition between the display area of these sub-regions and the lighting area adjacent to it or at least partially overlapping these sub-regions. For instance, one large projected area may be used to generate 2, 3, 4 or even more virtual screens areas, either stitched together or with a space in-between.

Figure 2c schematically shows, on the right end corner, an example of light- intensity filter profiles A, B and C applied to a visual content. For each of the light intensity filter profiles A, B and C, the visual effect on the visual content is also illustrated in the top two graphs and lower graph on left end corner of Figure 2c. In these examples only filtered white images are shown. However, any type of image or video may be projected and filtered in the same manner.

The same filter profile is applied to the vertical and horizontal directions of the visual content but adapted to the different number of pixels present in the visual content (image or video) in either of the two horizontal or vertical directions.

Light intensity profiles A and B have a parabolic shape and are of the same type of profile 230 described with reference to Figure 2b.

In profiles A and B, light intensity starts to fall off with a parabolic shape at an area in-between the center of the display area and the edge of the display area both in the vertical and horizontal direction. The effect is that light intensity is gradually decreasing from the area in-between the center of the display area and the edge of the display area such that a smooth transition is visible from brighter area towards darker areas. In other words, after applying the light-intensity filter to the visual content, for example with a profile A or B, a vignette effect is visible in the visual content towards the edge of the display area.

Since profile C shows very limited or no vignetting of the visual content, profile C may be less preferred than profile A or B.

Figure 2d schematically shows an example of a projected visual content blended with light according to an embodiment of the invention. The projected image has for example been filtered with a filter profile A or B described with reference to Figure 2c. Darker areas of the display area shown in Figure 2c for filter profile A or B have been illuminated by a filling or ambient light according to an embodiment of the invention, in this example by using 12 external light RGB spot and RGB PAR sources. The sources are pointing towards different locations with respect to the projected scene. The intensity and color of the light sources is tuned with respect to the projected scene for optimal blending. For instance, the blue sky of the projected area may be extending in blue in the lighting area surrounding this area of interest. Similarly the white clouds may be extending in white and the beach sand at the bottom of the projected area may be extended in light-yellowish light. The visual effect is that of having one image without edges between the display area and the lighting area and a total scene with an intensity and color matching perception. The ambient light is integral part of the visual content and vice versa.

Figures 3a-3b show different implementations of the lighting-systems partially integrated in Ultra-short throw (UST) projectors or short throw (ST) projectors.

UST and ST projectors are projectors operating usually from distances of few meters. Depending on the application area it may be desired to have a minimally obtrusive system, for example without the possibility for a user to come in between the projected visual content or light beam and the display area (e.g. a screen, a wall, a floor or a ceiling). This would be possible using an ultra-short throw (UST) projector, operating typically at distances as short as 30cm from the display area, i.e. the screen.

A high-resolution visual content may be projected with an UST projector 109.

Figure 3 a shows a lighting system 103 wherein ambient light can be generated with another UST projector 120 having lower resolution. UST projector 120 may be placed at slightly larger distance from the screen than UST projector 109 to result in larger illuminated area. For optimal intensity homogeneity and optimal intensity and color control and response in relation to the display area multiple light sources or lamps may be used directed towards different regions of the lighting area.

Instead of another UST projector, ambient light can be generated by another dedicated lamp or another normal front projector.

Figure 3b shows a lighting system 104 wherein ambient light can be generated within a UST projector 110. The light sources generating the ambient light are integrated with an UST projector 110 in a device consisting of a UST and multiple RGBW lamps with directional optics such that each lamp illuminates specific parts of the lighting area.

The integrated light sources or dedicated lamp or light projector can comprise a RGBW LED array luminaire as for example described with reference to Figure lc. The array can be integrated with UST-TV projectors for creating a kind of custom wall washing effect. The optics for the light sources should be designed to create more narrow and asymmetric individual beams with cut-off distribution for illuminating more distant areas and wider beams for closer areas. In order to be able to keep the center screen area dark and still have lighting effect on the lighting area at opposite sides of the screen from the UST projector another luminaire with similar light sources may be added to the opposite side of the screen area, either at the top side of the screen area if the UST projector is for example arranged at the bottom, or at the left side if the UST projector is for example arranged at the right side.

Figure 3c shows an example of lighting-system 105 where a luminaire 154 is arranged at the top side of the display area, i.e. at the opposite side of UST projector 110 for the above mentioned purpose.

The embodiments with UST projectors may be preferred for their unobtrusiveness, easier screen size scalability and integrated solution when combined with LED array luminaire.

Figures 4a-4e show different implementations of lighting-systems incorporating the ambient light function and fully integrated in an integrated lighting system device, for example a digital light processing (DLP) projector. Integrated lighting system devices 115-118 described with reference to the Figures 4a-4d may be used with or without a hardware or digital light-intensity filter for filtering the light intensity of the visual content according to the embodiments described above.

Figure 4a shows an integrated lighting system 115. Integrated lighting system 115 comprises projection lens 140, an illumination system comprising either light source 149, or 159 or 160 for generating and emitting ambient light, further light source 153 for generating the projection light, and an integrator rod 157 for mixing the projection light into a light beam 158.

Integrated lighting system device 115 further comprises a digital mirror device 155 for reflecting part of the light generated by further light source 153 towards the projection lens for projecting the visual content.

Digital mirror device 155 may be a digital micro-mirror device (DMD).

Light source 149 may be located anywhere between digital mirror device 155 and projection lens 140.

In the embodiment shown in Figure 4a, light source 149, e.g. an LED array (in ring or rectangle form) surrounds digital mirror device 155. In this embodiment the image of LED sources 149 will be sharply projected via additional optical elements 145 or/and a projection lens 140 on a screen 146. To blur the lighting effect, the position of the LED array can be brought closer to projection lens 140. Also to direct the light to the areas beyond the projected data area, additional optical elements 145 can be used adjacent to projection lens 140.

In an embodiment, light sources 149 may be replaced by transparent emitters 159 (e.g. transparent OLED, structured/segmented backlight). Usage of a transparent emitter allows for flexibility in displaying lighting effect both within and outside the projected content area. The transparent emitters can be placed in between integrator rod 157 and the digital mirror device. The transparent emitters may be placed after digital mirror device 155. In the latter case the light collecting efficiency will be larger.

In an embodiment, integrated lighting system device 115 may comprise additional reflecting elements surrounding digital mirror device 155 to capture light outside the projector etendue.

In an embodiment, the light source for generating the ambient light may be a non-transparent light source 160, e.g. Chips on Board (CoB) LED or an addressable LED matrix, coupled into an optical path after digital mirror device 155 with an optical element 156, e.g. a prism.

Additional optical elements 145 are not necessary for projecting the ambient light. Projection lens 140 may instead be used as far as ambient light is projected outside the intended projector etendue.

In an embodiment, the lighting-system comprises only projection lens 140 to accommodate the ambient light next to the projection light and project the ambient light and the projection light with the same projection lens.

Figure 4b shows an integrated lighting system device 116. Integrated lighting system device 116 differs from integrated lighting system device 1 15 in that the ambient light and the projection light are both provided from a single light source 165. In other words, the light for projecting light is generated out of the light source which is used to generate the light for projecting the visual content. Light source 165 may be used in combination with a switchable mirror 175 placed between integrator rod 157 and digital mirror device 155 or between light source 165 and integrator rod 157 for extracting the ambient light.

For example, switchable mirror 175 may be a full light mirror, non-color selective, for example based on a digital mirror device. Switchable mirror 175 may be rotating wheel having portions transmitting light and portions reflecting light which reflect part of the light generated by light source 165 for generating the ambient light. The digital mirror device may be switched or the rotating wheel may be configured to be rotated between the transmitting and the reflecting portions at a predetermined frequency. The predetermined frequency may be less than the frequency with which the light sources red, green and blue R, G and B are switched on and off.

In an embodiment, the predetermined frequency may be at least three times lower the switching frequency of the light sources R, G and B. In an embodiment, the predetermined frequency may be at least four times or less, lower than the switching frequency of the light sources R, G and B.

For example, the predetermined frequency may be 200 Hz while the switching frequency of the light sources R, G and B may be 1 KHz.

In an embodiment, instead of switchable mirror 175, a dichroic color filter wheel may be used. In the latter embodiment, the ambient light may be generated

sequentially with the projection light.

For example, during on time of the light sources R G and B, the dichroic color filter wheel may be configured to sequentially transmit red R light, green G light and blue light B to digital mirror device 155 via a set of lenses 170 and a mirror 171.

When red light R is transmitted by the dichroic color filter wheel, green light

G and blue light B is reflected towards a further mirror 172 such that green and blue lights G and B are extracted for generating the ambient light. The generated ambient light is then projected on screen 146 via for example an additional optical element 147.

When green light G is transmitted by the dichroic color filter wheel, red light R and blue light B is reflected towards further mirror 172 such that red and blue lights R and B are extracted for generating the ambient light. The generated ambient light is then projected on screen 146 via additional optical element 147.

Similarly, when blue light B is transmitted by the dichroic color filter wheel, red light R and green light G is reflected towards further mirror 172 such that red and green light R and G is extracted for the ambient light and projected on screen 146 via additional optical element 147.

The dichroic color filter wheel may thus be synchronized with the duty cycle of the red green and blue light sources R, G and B in order to provide the desired sequence of color and lights for light projection and ambient light.

In an embodiment, the projector may comprise a transflector arranged between light source 165 and integrator rod 157 or between integrator rod 157 and digital mirror device 155 to partially transmit and partially reflect part of the light generated by light source 165 all the time. A transflector may be provided for each R, G and B light source.

Alternatively, a single transflector may be provided after light source 165 arranged between light source 165 and integrator rod 157. A similar arrangement may be used when, instead of

R, G and B light sources, a white lamp is used.

In any of the embodiment described above using sequential switching of the colored light sources R, G and B, some sort of color tuning may be desired. In an

embodiment, color tuning may be provided by device 176, which filters the amount of light reflected by mirror 172 in the different time frames of the DLP such that the projected light has the desired color. The device 176 may be a rotating filter wheel, a switchable color filter or a switchable color display. A shutter may be used to block or dim undesirable color. The light reflected by mirror 172 may also be split into the individual colors, for instance by dichroic optics, into separate R, G and B light beams. The R, G, B beams may be controlled in intensity by the pulse current of the LED sources or by additional dimming means, such as a switchable aperture or a switchable filter. The R, G, B beams may be combined in a controlled ratio to obtain a desired mixed color state.

Figure 4c shows an integrated lighting system device 117. Integrated lighting system device 117 uses light from the single light source 167 to generate ambient light. For example, part of the spectrum of the light generated by light source 167 may be filtered because not used for generating color rendition of the projected visual content.

For example, in an embodiment, light at the blue side and red side of the spectrum may be pre-filtered within light source 167 and used for generating ambient light 169. Ambient light 169 may be then reflected by mirror 173 to direct the ambient light towards additional projection lens 145.

In an embodiment, light may be collected before integrating rod 157, by means of a reflective aperture 177 arranged between light source 167 and integrating rod 157.

The reflective aperture may be provided with a central hole for transmitting light towards integrating rod 157, and with a reflective surface oriented such to direct ambient light towards additional projection lens 145, for example in the embodiment shown in Figure 4c via mirror 174.

In an embodiment, the light may be collected from light reflected from digital mirror device 155. For example, some of the light reflected by digital mirror device 155 may not reach projection lens 140, and thus would not be used for projection. This light may be collected by a suitable mirror arranged next to digital mirror device 155 or around digital mirror device 155 for directing collected ambient light to additional lenses 145. This allows to recover some of the light that would be lost in the projection device because it is not used for projection of the visual content. The digital mirrors may be switched to a direction for use as display light via a projection lens, or to a dump location for waste light or to a light beam direction to form the light source beam. Within the switching frequency of the light sources a simultaneous operation of the display beam and the light beam may be realized by using part of the on-time for the display beam and part of the on-time for the light beam.

In an embodiment, not shown in Figure 4c, light source 167 may comprise transparent cooling plates or blocks for cooling the light source and prevent damage of the light source due to internal increase of the temperature. Ambient light may be collected through the transparent cooling plates or blocks and directed to additional lenses 145 in the same manner as for the embodiments explained above.

Figure 4d shows an integrated lighting system device 118. Integrated lighting system device 118 increases projection etendue of the light source, i.e. the extent to which the light generated by the light source is spread out in area and angle. This can be done in any manner suitable for the specific implementation.

In an embodiment, a bigger digital mirror device may be used, wherein, for example, part of it, say the central part is arranged to reflect light for projection of the visual content and the remaining, most significant part, is arranged for projecting the ambient light.

In an embodiment, multiple integrator rods may be used. For example, a first integrator rod may be used to direct light towards the digital mirror device and a second integrator rod may be used to direct light towards additional lens for projection of the ambient light.

In an embodiment, a High Lumen Density (HLD) source with luminescent rods may be used; such a luminescent rod may be tapered, to generate a light source with increased etendue. In the latter embodiment, only an angular and spatial region corresponding to a specified etendue for projecting the visual content is collected for projection of the visual content. The light that falls outside the specified etendue may be collected for example with a reflective aperture as explained for the embodiment described above with reference to Figure 4c. For example, Figure 4d shows a schematic drawing of a green HLD G and a red HLD R using both a luminescent rod pumped by LEDs (not shown in the figure). Both front side and back side of the rods of the green and red HLDs are used for light generation. Light from the front side of the rods is used for projection, while light from the back side is used for illumination of the lighting area.

The rod of the green HLD is tapered in shape. Light from the small front side is used for projection, light from the broad backside is used for illumination, typically in combination with a pick-up lens or a CPC (compound parabolic concentrator) extraction optic (both not drawn).

In any of the embodiment of the projectors described above, light sources 153, 165, 173 may comprise a LED or an array of LEDs. For example, the LED may be a R,G,B LED or R,G,B,W, LED of the same type as described with reference to Figure lc. Light sources 153, 165, 173 may also be a mixture of LEDs and High Lumen Density (HLD) light sources. For example, lights sources 153, 165, 173 may comprise B LED, R LED and G HLD or B LED, R HLD and G HLD or fully consist of B HLD, G HLD and R HLD or mixtures of the various source types.

Other alternative embodiments for providing an integrated light source in a projecting device are feasible. Neither the projection lens, nor an additional projection lens is required for projecting the ambient light onto the display area and/or lighting area.

In an embodiment, the light source may comprise one or more LEDs each having individual optical elements. These LEDs may be arranged around the projection lens or arranged in a separate lamp external to the projecting device.

The optical elements can be lenses, reflectors, total internal reflection (TIR) collimators, CPC, Fresnel lenses or combination of these elements resulting in a narrow light beam. In an embodiment, a beam angle of the projected ambient light from the light source depends on a distance of the light source from the display area. For example, a distance of the projecting device from the display area may be in a range of 1-5 meters. In this embodiment, light beams which are spreading from the light source may have a beam angle in the range of 6 - 30 degrees.

In an embodiment, the light source may be provided with a zoom lens system for providing dynamic control of the beams angle.

In an embodiment, light beams generated by the light source may be directed towards different areas on the screen. This can be done mechanically by pre-positioning individual sources with respect to the projected area, or by having initially narrow collimated light beams (e.g. after TIR collimators) and then applying optical micro-structures for re- directioning of the beams from individual sources.

In an embodiment, non-symmetrical linear micro -prismatic structures can be used for beam re-direction in a wide angular range (as an example a direction turning film of

Luminit).

In an embodiment of the lighting- system the projecting device is turned off and the light source is configured to direct the ambient light towards the center of the display area. This enables a more uniform lighting distribution when the projecting device is in the off state.

In an embodiment, lighting-system may comprise one or more light sources arranged in a ring or oval- like shape. The advantage of having such arrangement is that a dip in light intensity levels about a center of the display area can be obtained. When an addressable matrix of LEDs is used, it provides a more flexible functionality for projected light distributions, including filling the central projection area.

In an embodiment, lighting-system may comprise one or more light sources arranged in a pattern surrounding the display area with an emission profile which is not rotationally symmetric. The angularly asymmetric light beam of the light sources are arranged such that the side with a wide angular spread is directed to the lighting area facing away from the display area and the side with a small angular spread is directed to the display area. As such the overlap area with the display area can be reduced in order to direct less light towards a central region of the display area. This allows to achieve a better contrast for the projected visual content. Asymmetrical light sources arrangement with respect to the center of the display areas provide a more rapid fall-off of intensity towards the content side and a wider fall-off towards the opposite side. This can be achieved using asymmetric optical elements or micro-structures, including asymmetric lenses, prisms, apertures/stops and so forth. Asymmetric micro-structures may be oriented differently for each light (LED) sources directing a light beam into different directions to contribute to a total spread light

distribution.

In an embodiment, resolution of the light source for projection of the visual content is higher than a resolution of the light source for projection of the ambient light.

However, a high resolution of the light source for ambient light can provide a better blending between the light and the visual content. In a simplest case the light distribution may have four lighting areas adjacent to the projection area. Each lighting area may be illuminated with groups of LEDs combined with simple light re-direction optical elements.

In an embodiment, the projecting device comprises optical fibers to deliver light from the light sources integrated in the projecting device or generated therein, to the outside of projecting device. First ends of the optical fibers may be optically coupled to said light sources and second ends of the optical fibers may be arranged around the projection lens for projecting the visual content. First end of the optical fibers may be optically coupled to, for example an addressable RGB(W) LED matrix generating the light to be coupled into the fibers. Fibers with low numerical aperture NA=0.1 result in quite narrow beams with divergence of +/- 6 degrees. Additionally, fibers may be supplemented with extra lenses providing even narrower beam or spreading optics for wider beams.

In an embodiment, lighting system may comprise internal light sources for generating light used for projection of the visual content and external separate light sources for projecting the ambient light.

Additional means can be used to blur images of the individual LED on a screen in the far field. This is possible by applying a diffuser in between the LEDs and the lens, placing LEDs slightly out of focal plane of the lens, or adjusting the lens position depending on the desired amount of blurring vs resolution in the lighting effect.

In another embodiment, the light source may comprise a backlight, operating in color-sequential white RGB-switching mode, and an addressable matrix on top of it (being e.g. an LCD matrix, or a PDLC) which in synchronization with backlight color switching provides an image of this color component to be imaged on the target screen for a desired light distribution (possibly in correlation with displayed content).

With reference to lighting-system 102 shown in Figure lc and projecting device 114 shown in Figure 2, network interface 123 of projecting device 113 or 114 and network interface 133 of lighting-system control device 130 may be connected to a network via a wire or wireless connection for receiving and/or transmitting the lighting control data. The network interfaces 123 of projecting device 113 or 114 and network interface 132 of lighting-system control device 130 may comprise wired or wireless transmitters and/or wired or wireless receivers capable to receive and/or transmit the lighting control data via a suitable wired or wireless communication technology. The projecting devices 113 or 114 may comprise said wired or wireless transmitters and/or receivers. Examples of suitable wired or wireless communication technologies are but not limited to Ethernet, Bluetooth, Zig-Bee, Wi-Fi, Bluetooth Low Energy, mobile cellular technologies such as GSM, EDGE, LTE.

Lighting control data transmitted to one or more programmable controller 152 changes the light intensity and/or the light spectrum of the visual content and/or the light source for providing an edgeless transition between the display area and the lighting area.

Figure 5 schematically shows a flow diagram for method of blending a visual content with light 500. The method comprises:

projecting 510 the visual content on a display area,

illuminating 520 at least partially the display area and a lighting area adjacent the display area, gradually reducing 530 the light intensity of the projected visual content from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

Gradually reducing 530 the light intensity of the projected visual content may further comprise determining 550 lighting control data to change the light intensity of the light source based on a light intensity of the visual content such that the blended visual content has a light intensity gradually reducing form the display area towards the lighting area.

Light intensities of the projector may be determined from or calibrated based on the specifications or measured light levels of the projector depending on the mode of operation of the projector. Light levels at the display area may be determined based on the light intensity of the projector and the size of the projected area or measured at the projected area. Light intensities of the light source may be determined from or calibrated based on specifications or measured light levels of the light sources and the level of dimming. Light intensities at the lighting area may be determined from the light intensity of the light source and the area of the lighting area. Alternatively, light-intensity level at the lighting area may be determined by the angular spread of the light sources and the distance between the light sources and the lighting area or it can be measured at the lighting area.

Typically the system is pre-configured to obtain the right balance in light levels, light positions of the lighting area and the display area and the level of overlap.

A camera systems can be used to analyze the light levels and/or color at the lighting area, the display area and the areas of overlap. The analyzed data can be used to correct, optimize or control the local balance between the light and color levels of the lighting and display area.

Method 500 may further comprise gradually changing 540 color of the visual content from the display area towards the lighting area.

Gradually changing the color 540 of the visual content may further comprise determining 560 a color from the visual content and determining 570 color control data to adapt a light spectrum of the light source and/or the visual content in a portion of the display area where the light-intensity is reduced.

Gradually changing the color 540 of the visual content may further comprise determining the color in an area of interest of the visual content. Adapting the light spectrum of at least one light source may comprise determining the light spectrum from the color in the area of interest.

In an embodiment of the method 600, gradually reducing 530 the light intensity of the visual content may be predetermined in the lighting-system. For example, the visual content to be projected, for the type of scene represented has inherently, i.e. natively, the light intensity reduced from the display area towards the lighting area in which case no further filtering or processing of the visual content is necessary. For example, the pre-filtered visual content may be analyzed by a processor. Based on the levels of light intensity present in the pre-filtered visual content, light-intensity filtering of the visual content may be applied with a more or less steep light-intensity filter distribution profiles or may not be applied at all. For example, in one setting of operation the filtering may always be applied, in another setting of operation, when e.g. the visual content has inherently the light intensity reduced from the display area towards the lighting area, the filtering may be omitted or the level of reduction of the light intensity across the display area be so low to be almost negligible.

In the various embodiments, the projecting device may comprise an input interface for receiving the input visual content. The input interface may be selected from various alternatives. For example, input interface may be a network interface to a local or wide area network, e.g., the Internet, a storage interface to an internal or external data storage, a keyboard, etc.

Typically, the projecting device 111-118, lighting- system control device 130 each comprise a microprocessor (not separately shown) which executes appropriate software stored at the device; for example, that software may have been downloaded and/or stored in a corresponding memory, e.g., a volatile memory such as RAM or a non-volatile memory such as Flash (not separately shown). The device 111-113, 130 may also be equipped with microprocessors and memories (not separately shown). Alternatively, the devices may, in whole or in part, be implemented in programmable logic, e.g., as field-programmable gate array (FPGA), or they may be implemented, in whole or in part, as a so-called application- specific integrated circuit (ASIC), i.e. an integrated circuit (IC) customized for their particular use. For example, the circuits may be implemented in CMOS, e.g., using a hardware description language such as Verilog, VHDL etc.

Many different ways of executing the method 500 are possible, as will be apparent to a person skilled in the art. For example, the order of the steps can be varied or some steps may be executed in parallel. Moreover, in between steps other method steps may be inserted. The inserted steps may represent refinements of the method such as described herein, or may be unrelated to the method. For example, steps 530, and 640 may be executed, at least partially, in parallel. Moreover, a given step may not have finished completely before a next step is started.

A method according to the invention may be executed using software, which comprises instructions for causing a processor system to perform method 500. Software may only include those steps taken by a particular sub-entity of the system. The software may be stored in a suitable storage medium, such as a hard disk, a floppy, a memory, an optical disc, etc. The software may be sent as a signal along a wire, or wireless, or using a data network, e.g., the Internet. The software may be made available for download and/or for remote usage on a server. A method according to the invention may be executed using a bitstream arranged to configure programmable logic, e.g., a field-programmable gate array (FPGA), to perform the method.

It will be appreciated that the invention also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice. The program may be in the form of source code, object code, a code intermediate source, and object code such as partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention. An embodiment relating to a computer program product comprises computer executable instructions corresponding to each of the processing steps of at least one of the methods set forth. These instructions may be subdivided into subroutines and/or be stored in one or more files that may be linked statically or dynamically. Another embodiment relating to a computer program product comprises computer executable instructions corresponding to each of the means of at least one of the systems and/or products set forth.

Figure 6a shows a computer readable medium 1000 having a writable part 1010 comprising a computer program 1020, the computer program 1020 comprising instructions for causing a processor system to perform a method of blending a visual content with light 600 according to an embodiment described with reference to Figure 5. The computer program 1020 may be embodied on the computer readable medium 1000 as physical marks or by means of magnetization of the computer readable medium 1000.

However, any other suitable embodiment is conceivable as well. Furthermore, it will be appreciated that, although the computer readable medium 1000 is shown here as an optical disc, the computer readable medium 1000 may be any suitable computer readable medium, such as a hard disk, solid state memory, flash memory, etc., and may be non-recordable or recordable. The computer program 1020 comprises instructions for causing a processor system to perform said lighting-system control method 600 or 700.

Figure 6b shows in a schematic representation of a processor system 1140 according to an embodiment. The processor system comprises one or more integrated circuits 1110. The architecture of the one or more integrated circuits 1110 is schematically shown in Figure 6b. Circuit 1110 comprises a processing unit 1120, e.g., a CPU, for running computer program components to execute a method according to an embodiment and/or implement its modules or units. Circuit 1110 comprises a memory 1122 for storing programming code, data, etc. Part of memory 1122 may be read-only. Circuit 1110 may comprise a

communication element 1126, e.g., an antenna, connectors or both, and the like. Circuit 1110 may comprise a dedicated integrated circuit 1124 for performing part or all of the processing defined in the method. Processor 1120, memory 1122, dedicated IC 1124 and communication element 1126 may be connected to each other via an interconnect 1130, say a bus. The processor system 1110 may be arranged for contact and/or contact-less communication, using an antenna and/or connectors, respectively.

For example, in an embodiment, the lighting-system control device 130 may comprise a processor circuit and a memory circuit, the processor being arranged to execute software stored in the memory circuit. For example, the processor circuit may be an Intel Core \Ί processor, ARM Cortex-R8, etc. The memory circuit may be an ROM circuit, or a non-volatile memory, e.g., a flash memory. The memory circuit may be a volatile memory, e.g., an SRAM memory. In the latter case, the verification device may comprise a nonvolatile software interface, e.g., a hard drive, a network interface, etc., arranged for providing the software.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments.

In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. In the claims references in parentheses refer to reference signs in drawings of embodiments or to formulas of embodiments, thus increasing the intelligibility of the claim. These references shall not be construed as limiting the claim.

Claims

CLAIMS:

1. A lighting-system (100) for blending a visual content with light, comprising:

a projecting device (111) for projecting the visual content on at least one display area (141),

at least one light source (151) for emitting the light and illuminating at least partially the display area (141) and at least a lighting area (142) adjacent the display area (141),

a light-intensity filter (121) for filtering a light intensity of the visual content, the light-intensity filter configured for gradually reducing the light intensity of the projected visual content (108) from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

2. A lighting-system (100) according to claim 1, wherein the light intensity filter is further configured for gradually changing the color of the projected visual content from the display area towards the lighting area for a smooth color transition between the display area and the lighting area.

3. A lighting system (100) according to any of the previous claims, wherein the light-intensity filter (121) is arranged to provide the visual content with a light intensity distribution profile from a center of the display area or from an area between the center of the display area and an edge of the display area with the lighting area, towards the lighting area, of a half-parabolic, half-cosine, half-Gaussian or half-Lorentzian shape.

4. A lighting system according to any of the previous claims, wherein the light- intensity filter is arranged to provide a light intensity- filtered visual content having a spatial distribution of an elliptical, circular, square or rectangular shape.

5. A lighting system according to any of the previous claims, wherein the light- intensity filter is a digital filter or a hardware filter arranged within an optical path of the projecting device.

6. A lighting system according to claim 5, wherein the hardware filter comprises a light-intensity neutral filter, or

one central opening at a central part of the filter corresponding to the display area, and a plurality of openings smaller than the central opening at another part of the filter corresponding to an edge of the display area with the lighting area for partially transmitting light at an edge of the central opening, or

a substrate transparent to light at a central part of the substrate corresponding to the display area and gradually more opaque to light or gradually more scattering light at another part of the substrate corresponding to an edge of the display area with the lighting area, or

a lens having a predefined shape for reducing light intensity of the projected visual content from the display area towards the display area.

7. A lighting-system (102) according to any of the previous claims, further comprising:

a programmable controller (152) configured to control a light intensity of the at least one light source (151), and

a lighting-system control device (130) comprising a processor circuit (132) configured to

determine lighting control data to change the light intensity of the at least one light source (151) based on a light intensity of the visual content in addition to gradually reducing the light intensity of the projected visual content (108), such that the blended visual content has a light intensity gradually reducing from the display area towards the lighting area and

transmit the lighting control data to the programmable controller (152).

8. A lighting-system (102) according to any of the previous claims, the projecting device (113) comprising a processor (124) configured to

determine a color from the visual content, and

determine color control data to adapt a light spectrum of the at least one light source and/or the visual content in a portion of the display area where the light-intensity is reduced in order to gradually change the color from the display area (141) towards the lighting area (142).

9. A lighting-system (102) according to claim 8, wherein the processor is configured to determine the color in an area of interest (144) of the visual content, the light spectrum of at least one light source being determined from the color in the area of interest (144).

10. A lighting system according to any of the previous claims, wherein the at least one light source comprises one or more solid state light emitters and/or the at least one light source is embedded in the display area and the lighting area.

11. An integrated lighting system device (114; 115) comprising the lighting system according to any of the claims 1 to 10, a projection lens (140) through which the visual content is projected and a further light source (153) for generating the light for projecting the visual content.

12. An integrated lighting system device (116; 117; 118) according to claim 11, wherein the at least one light source and the further light source are one light source (165,

167).

13. An integrated lighting system device according to any of the claims 11 or 12, further comprising:

- a digital mirror device (155) for reflecting part of the light generated by the further light source (153; 165; 167) towards the projection lens for projecting the visual content and/or

at least one additional optical element (145, 147) through which the light of the at least one light source is projected.

14. A method of blending a visual content with light, comprising:

projecting (510) the visual content on at least one display area, illuminating (520) at least partially the display area and at least a lighting area adjacent the display area, gradually reducing (530) the light intensity of the projected visual content from the display area towards the lighting area for blending the visual content with the light such that an observer of the blended visual content sees an edgeless transition between the display area and the lighting area.

15. A computer readable medium (1000) comprising transitory or non-transitory data (1020) representing instructions to cause a processor system to perform the method according to claim 14.