WO2006005231A1 - A portable panoramic photographic apparatus - Google Patents

A portable panoramic photographic apparatus Download PDF

Info

Publication number
WO2006005231A1
WO2006005231A1 PCT/CN2004/000804 CN2004000804W WO2006005231A1 WO 2006005231 A1 WO2006005231 A1 WO 2006005231A1 CN 2004000804 W CN2004000804 W CN 2004000804W WO 2006005231 A1 WO2006005231 A1 WO 2006005231A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
photo
panoramic
image
digital
Prior art date
Application number
PCT/CN2004/000804
Other languages
French (fr)
Chinese (zh)
Inventor
Kun Ma
Original Assignee
Kun Ma
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kun Ma filed Critical Kun Ma
Priority to PCT/CN2004/000804 priority Critical patent/WO2006005231A1/en
Publication of WO2006005231A1 publication Critical patent/WO2006005231A1/en

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/02—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with scanning movement of lens or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the present invention relates to a digital photographing apparatus, and more particularly to a digital portable photographing apparatus having a panoramic photographing function, which belongs to the field of digital photographing technology. Background technique
  • the panoramic camera includes a camera body, a lens, a power controller and a camera chassis.
  • the imaging surface of the slit exposure hole is opened in the middle of the fuselage, and the chassis under the fuselage is equipped with a motor and a speed reducer;
  • the controller is a three-speed control motor variable speed regulator.
  • the device is highly accurate and suitable for indoor panoramic views, wide field scenery and large group photos, but requires additional mechanical devices and drive components, which are not suitable for portable use.
  • a photo is digitized into a megapixel digital collection, and the processing of the photo can make full use of high-speed and large-capacity computers for pixel-level editing.
  • the splicing and combination of multiple photos is simplified to the reorganization of the corresponding pixel set. arrangement. Two photos with partial overlap can be matched in the computer first, the overlapping positions are located, and then the content is continuously spliced into a larger photo. In this way, the imaging field of view can be expanded and the image quality can be improved without changing the imaging equipment.
  • the disadvantage of this solution is that it is offline and non-real-time: The user first takes multiple photos in succession using a conventional camera, and then inputs the photos to a computer for sorting, matching, and splicing. This inevitably results in a long processing cycle and troublesome operation, once individual photos do not meet The request will cause the entire splicing to fail, and the user needs to retake and repeat the above operation.
  • the main purpose of today's digital cameras is shooting and storage.
  • the basic structure is shown in Figure 1. It includes a module 21, a control module 22, a storage module 23, and of course, a power module or the like not shown in the figure.
  • the imaging module 11 includes a photoelectric image sensor and a sensor signal processor for performing photoelectric signal conversion and processing of the image, and converting the data into a data format acceptable to the back-end integrated circuit.
  • Control module 12 performs storage of image data in storage module 13 and communication with the computer.
  • the main problem to be solved by the present invention is to overcome the shortcomings of the limited field of view of the existing portable camera, and to provide a digital portable photographing apparatus having a panoramic photographing function.
  • the technical solution of the present invention is: a digital portable photographing device having a panoramic photographing function, comprising a control module, a digital module, and a photo storage module for storing the photographed photograph, the control module and the number respectively
  • the imaging module and the photo storage module are electrically connected; the first buffer memory is used to store the photo of the main body; the second buffer memory is used to store the post photo; and the overlapping area between the rear photo and the main photo is used.
  • the photographing device of the present invention can work in the normal shooting mode and the continuous shooting mode.
  • the continuous shooting mode the first photo is taken according to the instruction input by the user, and is temporarily stored as the main photo.
  • the next photo is taken and temporarily stored as a subsequent photo; and the image matching module analyzes the state of the overlapping area between the subsequent photo and the main photo, including whether there is Overlap, overlap range size, etc.; then by image stitching module based on The state of the overlapping area between the photo and the main photo is taken, and the two are combined into a continuous new photo, and taken as a new main photo into the first buffer memory; after the shooting, the last The main photo is saved as a panoramic photo to the photo storage module.
  • the invention introduces real-time processing and intelligent recognition technology into the photographing device, adopts human-machine cooperation to complete active framing, continuous shooting and intelligent splicing, and forms a novel and practical on-site panoramic photographing device: intelligently splicing the photos taken by the user , to achieve "immediately shoot, fight, and shoot.”
  • the present invention does not require any additional mechanical or optical equipment, is small and portable, and maintains the usual manual shooting habits; the present invention does not require the operator to rotate the photographing apparatus very accurately, is convenient to use, and has the advantage of on-site imaging.
  • Figure 1 is a schematic block diagram of a conventional digital camera
  • FIG. 2 is a schematic block diagram of an embodiment of the present invention.
  • FIG. 3 is a schematic block diagram of another embodiment of the present invention.
  • Figure 5 is a diagram showing an example of a 5-way key used in an embodiment of the present invention.
  • Figure 6 is a circuit diagram of the digital camera of the present invention shown in Figure 2;
  • Figure 7 is a flow chart when continuous panoramic shooting is performed using the camera of the present invention.
  • Figure 8 is a first photograph of a panoramic shot taken in accordance with the present invention.
  • Figure 9 is a second photograph of a panoramic shot of the present invention.
  • Figure 10 is a schematic view showing the overlapping portion when the splicing is performed in Figures 8 and 9;
  • Figure 11 is a panoramic photograph of Figure 8 and Figure 9. detailed description
  • FIG. 2 An embodiment of the present invention is shown in FIG. 2. As can be seen from the figure, the embodiment is in FIG. The improvement of the digital camera shown.
  • the first buffer memory 25, the second buffer memory 26, the image matching module 27, and the image splicing module are included in addition to the digital imaging module 21, the control module 22, and the photo storage module 23 connected to each other in the ordinary digital camera. 28.
  • the image matching module 27 and the image splicing module 28 can be integrated into a digital processor, which can be a dedicated processor, a programmable processor, or a general-purpose integrated circuit using dynamic reconfiguration technology.
  • the first buffer memory 25 and the second buffer memory 26 may be two storage areas of the same buffer memory; the first buffer memory 25 and the second buffer memory 26 may also be independent buffer memories, respectively, or Each is composed of more than one buffer memory.
  • the configuration of the first buffer memory 25 and the second buffer memory 26 can be specifically determined according to the photo data capacity to be stored and the photo data format, the photo data size, and the memory chip used in the design. These determination methods may be specifically performed by the designer according to the design requirements and the related memory chip technical manual, and are common technical means of those skilled in the art, and are not described herein again.
  • the digital camera of the embodiment can operate in a normal shooting mode or a panoramic shooting mode.
  • the normal shooting mode is equivalent to the traditional photo taking, that is, taking one picture and saving one.
  • the first photo is taken according to the instruction input by the user, and is temporarily stored as a main photo in the first buffer memory 25; then the next photo is taken according to the instruction input by the user, and The image is temporarily stored in the second buffer memory 26;
  • the image matching module 27 analyzes the state of the overlapping area between the subsequent photo and the main photo, including whether there is overlap, overlapping range size, etc.;
  • the image splicing module 28 performs a splicing process on the overlapping area between the contiguous photo and the main photo, splicing out a continuous new photo, and placing it as a new main photo in the first buffer memory 25; After that, the last subject photo is saved to the storage module 23 as a panoramic photo.
  • the present invention further includes a display unit 29 for displaying a photograph taken, the control module 22 is connected to the display unit 29, and the control unit controls the display unit 29 to display according to the state of the display button provided on the photographing device. Or stop showing.
  • a play module 291 may be further provided.
  • the play module 291 is connected to the control module 22, and may be combined with the image matching module 27 and the image splicing module 28. Integrated into the digital processor. Under the control of the control module 22, the playback module 291 extracts a panoramic photo from the first or second buffer memory or photo storage module connected thereto, and performs the panning.
  • buttons 292 for controlling playback are further provided on the photographing device, and the buttons 292 are connected to the control module 22, and when the buttons 292 are pressed, the control module 22 Collecting corresponding button signals, and then transmitting the signals to the playing module 291.
  • the playing module 291 adjusts the playing of the panoramic photo according to the corresponding signal, for example, receiving the leftward
  • the playing module 291 replaces the photo content currently displayed in the display unit 29 with the photo content shifted to the left by one step, and the effect of moving the photo to the left is achieved; likewise, when receiving the rightward,
  • the button signal is moved up and down, it also corresponds to the corresponding operation.
  • the stop button signal is received, the content currently being displayed is fixedly displayed.
  • a speed control button for controlling the play speed adjustment signal may be further provided, and the speed control button is also connected to the control module 22, and when the play module 291 receives the control When the speed adjustment signal is forwarded by the module 22, the moving speed of the current panoramic image is adjusted accordingly until the viewer is satisfied.
  • a clock and a position counter for dynamically playing back the panoramic photo in the photo storage module 23 may be disposed in the display unit 29, and based on the position counter, automatically scrolling to display a large-format panoramic photo, and also The display status can be changed in real time in response to the user's "up, down, left, right, stop” and other key operations.
  • Fig. 5 shows an example of the five-way key, which includes an up key 31, a down key 32, a left key 33, a right key 34 and a stop key 35. These keys respectively connect their outputs to the control module 22 for transmitting the key signals to the control module 22. Since the connection of the upper number is a basic skill of the skill and the technician, it is not directly shown in Fig. 6.
  • the imaging module 21 uses a single-chip high-resolution digital camera chip OV7620
  • the control module 22 uses a chip OV681
  • the storage module 23 uses a CMOS FLASH memory AM29LV160D
  • an image matching module 27 is integrated.
  • the digital processor functioning with the image splicing module 28 uses the MC68VZ328 and uses the SDRAM HYB39S6416A as the buffer memory 25, 26.
  • the OV7620 includes a photoelectric image sensor and a sensor signal processor for performing photoelectric signal conversion and processing of the image, and converting it into an acceptable data format of the AM29LV160D, HYB39S6416A and MC68VZ328.
  • 0V681 controls the storage of image data in the AM29LV160D and communication with the MC68VZ328.
  • the MC68VZ328 is a programmable digital processor that is programmed with image matching and image stitching modules.
  • the HYB39S6416A is divided into two data buffer spaces by the MC68VZ328 through the setting of the address space, as a first buffer memory for storing a subject photo and a second buffer memory for storing a subsequent photo.
  • Figure 6 shows the circuit diagram of the digital camera shown in Figure 2, which shows the electrical connection between the MC68VZ328 and the HYB39S6416A and AM29LV160D.
  • the present invention can operate in the normal shooting mode and the continuous shooting mode, and in the continuous shooting mode, can operate in the flow shown in FIG.
  • the user should first aim at the first viewing range according to the panoramic range that needs to be shot. If shooting from left to right, first align with the leftmost viewing range. Of course, you can also press right to Shooting left, top to bottom, or bottom to top; at this point, the image of the framing range that the camera's shooting lens is aimed at will be transmitted to the display for real-time display, for the user to determine whether it is aligned The required range of view and corresponding adjustments;
  • the user After determining the framing range of the first photo, the user can take the first photo by pressing the capture button, and the scene of the framing range to which the photographic lens is currently aimed is imaged by the OV7620.
  • the 0V681 and MC68VZ328 control are saved as the main picture to the first buffer memory in the HYB39S6416A, and the next framing state is automatically entered.
  • the image matching module in the MC68VZ328 determines in real time the overlap range between the image of the current framing range and the current subject photo (as shown in Figure 10), and calculates the current overlapping area as a whole. Ratio of image area; if the overlap area is found to be greater than 25%, a rotation signal to the right is issued to reduce the overlap; if the overlap area is found to be less than 15%, a leftward rotation prompt signal is issued to increase Overlap; When the overlap ratio is about 20% (between 15 and 25%), a shooting alert signal is issued, prompting the user to be the best shooting range at this time.
  • the prompt signal here may be an icon or text displayed by the display, a sound emitted by the sound emitting device, or a light emitted by the light emitting device.
  • the user can adjust the body angle or shooting angle according to the above prompt signal, and select a suitable scene to take a follow-up photo by pressing the capture button, and the photo is saved to the second buffer memory in the HYB39S6416A. _
  • the image splicing module in the MC68VZ328 automatically splicing the above-mentioned main photo and the subsequent photo, 4 and taking out a new continuous photo, and saving it as the new main photo to the first in HYB39S6416A In the buffer memory; at the same time automatically enter the next framing state.
  • the last generated body photo will be generated. It is output as a panoramic photo to the photo memory module AM29LV160D, or output to a flash memory external to the camera through a standard interface, or output to other non-volatile memory.
  • the monitor will automatically scroll through the panorama and respond to the user's button controls. If the user presses the left button 33 in Fig. 5, the system scrolls to display the photo to the left; if the user presses the right button 34, the system scrolls to the right to display the photo; similarly, the five controls of "up, down, left, and right" are implemented.
  • the implementation of the image matching module in the above step (4) is based on the hardware and software implementation of the image matching algorithm by the digital processor. In principle, it consists of two parts, namely content consistency measurement and scene overlap area positioning.
  • a digital image When two photos are digitized into a set of numbers based on pixels (hereinafter referred to as a digital image), the content comparison of the two photos can be converted into a comparison of the corresponding pixels; thus, the corresponding pixels of the two digital images can be The average difference is defined as a simple measure of the consistency of the content in the image. In mathematical terms, the measure is a distance measure of the two vectors that are formed by the two digital images.
  • This content consistency measure applies not only to the overall consistency measurement of two digital images, but also to its locality measurements. For example, two photos only have partial content overlap. Then, the average difference of the corresponding pixels is counted in the overlapping area in the case where the content is actually overlapped, and the difference value is small; on the contrary, for other overlapping positions, the corresponding content is different, and the statistical average value based on the pixel difference is large, thus The content consistency measure value becomes larger.
  • the content consistency measure to automatically locate the scene overlap area: first calculate the content consistency measure value of the two photos in the candidate overlap position; select the smallest content consistency measure value, when the value is obtained
  • the overlapping position is the exact scene overlap position of the two images.
  • the above image matching algorithm is used to automatically and accurately locate the scene overlapping positions of the two photos.
  • the image splicing module of the present invention is also simplified into the recombination and arrangement of the corresponding pixel sets of the two images: selecting the pixel value at the overlapping position in the newly synthesized image by selecting the linear weighting method in the overlap region, The corresponding pixel value of the original image is retained outside the overlap area.
  • the present invention requires a certain overlap between the photographs taken, and the purpose is only to provide sufficient and accurate image data for the image stitching module to complete a continuous and complete image stitching.
  • the more overlap between adjacent photos the more matching information, but the lower the expansion efficiency; on the contrary, the less overlap between adjacent photos, the less the data guiding the image stitching, which may affect The accuracy of image stitching.
  • 20% is selected as the recommended overlap area in the above embodiment of the present invention.
  • FIG. 8 is a first photograph
  • FIG. 9 is a second photograph taken by the present invention.
  • a portion of the image on the right side of FIG. 8 and a portion of the image on the left side of FIG. 9 are substantially the same. of.
  • Fig. 10 substantially the same images in Figs. 8 and 9 are overlapped with each other, and finally a panoramic image as shown in Fig. 11 is generated.
  • the device can take 360-degree panoramic photos, beyond the limits of its physical lens, and the images are generated on-site.
  • the resulting image is continuous and complete, rich in content, and the visual quality is significantly better than that of a single camera.
  • the present invention replaces a series of complicated manual operations such as printing, cutting, and pasting, as well as special processing on a computer, and the operation is simple and the effect is obvious.
  • the solution of the present invention is applicable not only to digital cameras, but also to mobile phones and other portable digital photography devices having shooting functions.
  • the premise is to add a digital processor with an image matching module, an image stitching module and a playback module, and a data buffer for implementing the buffer in a digital camera or other portable digital photography device.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

A portable digital camera with real-time successively taking panoramic images function includes the first and the second buffer memory for storing main image and succeeding image respectively, an image matching module for analyzing condition of overlaid area between succeeding image and main image and an image splicing module for connecting succeeding image and main image as one new integral image and storing it as a new main image into the first buffer memory based on output results from the image matching module, excepts for a controlling module, a digital imaging module and an image memory module. The resulting main images are stored intothe image memory module under controlling of the controlling module.

Description

具有全景拍摄功能的便携式拍照设备  Portable camera device with panoramic shooting function
技术领域 Technical field
本发明涉及一种数码拍照设备， 更具体地说涉及一种具有全景拍摄功能的 数字便携式拍照设备， 属于数字照相技术领域。 背景技术  The present invention relates to a digital photographing apparatus, and more particularly to a digital portable photographing apparatus having a panoramic photographing function, which belongs to the field of digital photographing technology. Background technique
成 ¾野受取景器的限制是一般相机都面临的问题， 针对这类问题， 人们 从机械、 光学及数字技术等多方面做了许多技术改进。  The limitation of the viewfinder is a problem faced by the general camera. For such problems, many technical improvements have been made from various aspects such as mechanical, optical and digital technologies.
例如， 在中国专利 ZL 92215421. X中， 公开了一种 360。 环摄全景照相机， 包括照相机机身、 镜头、 电源控制器及相机底盘， 机身中间开有一缝隙式曝光 孔的成像面， 机身下的底盘内装有 ^啟型电机和减速器； 其电源控制器为三挡控 制电机变速的调压器。 该装置精度高， 适合拍摄室内全景， 野外宽阔画风景和 大型团体照等， 但需添加额外的机械装置和驱动部件， 不适于便携使用。  For example, in Chinese Patent ZL 92215421. X, a 360 is disclosed. The panoramic camera includes a camera body, a lens, a power controller and a camera chassis. The imaging surface of the slit exposure hole is opened in the middle of the fuselage, and the chassis under the fuselage is equipped with a motor and a speed reducer; The controller is a three-speed control motor variable speed regulator. The device is highly accurate and suitable for indoor panoramic views, wide field scenery and large group photos, but requires additional mechanical devices and drive components, which are not suitable for portable use.
在中国专利申请 00802545. 2 (公开号 CN 1352754 ) 中， 公开了一种两反射 器***， 一个是双曲面反射镜， 另一个是凹椭圓或球面反射镜， 通过光学原理 消除光学像差， 用于捕获超广角全景图像。 但是其精密而庞大的光学设备同样 不适宜小巧灵活的便携设备。  In Chinese Patent Application No. 00802545. 2 (Publication No. CN 1352754), a two-reflector system is disclosed, one being a hyperbolic mirror and the other being a concave elliptical or spherical mirror, which optically eliminates optical aberrations. Used to capture super wide-angle panoramic images. But its sophisticated and large optical equipment is also not suitable for small and flexible portable devices.
近年来， 数字技术的应用极大地促进了成像技术的发展。 数码成像技术的 最大好处是处理准确灵活。 一张照片被数字化为百万像素的数字集合， 进而对 该照片的处理可充分利用高速大容量的计算机进行像素级的编辑， 对多幅照片 的拼接组合也就简化为相应像素集合的重组和排列。 具有部分重叠的两张照片 在计算机中可以先进行内容匹配， 定位出重叠位置， 然后按内容连续地拼接为 一张更大的照片。 这样， 在不更改成像器材的情况下， 即可达到扩展成像视野、 提高成像质量的目的。 该方案的缺点在于其离线非实时性： 使用者首先使用传 统相机连续拍摄多张照片， 然后再将这些照片输入到计算机进行排序、 匹配、 拼接。 这不可避免地造成了整个处理周期长、 操作麻烦， 一旦个别照片不合乎 要求， 将导致整个拼接失败， 使用者需要重新拍摄并重复上述操作。 现今的数码相机， 主要用途是拍摄和存储， 其基本结构如图 1所示。 包括 成 ^ 莫块 21、 控制模块 22、 存储模块 23, 当然， 还包括未在本图中画出的电 源模块等部分。 其中， 成像模块 11包括光电图像传感器和传感器信号处理器， 用来完成图像的光电信号转换及处理工作， 将其转换为后端集成电路可以接受 的数据格式。 控制模块 12完成图像数据在存储模块 13中的存储及与计算机的 通信。 该方案简单经济， 可以满足用户拍摄单张照片并保存的需要。 但上述结 构中并没有用于实时处理多幅图像拼接的装置或部件， 因此无法满足现场全景 拍照的要求。 发明内容 In recent years, the application of digital technology has greatly promoted the development of imaging technology. The biggest benefit of digital imaging technology is the accuracy and flexibility of processing. A photo is digitized into a megapixel digital collection, and the processing of the photo can make full use of high-speed and large-capacity computers for pixel-level editing. The splicing and combination of multiple photos is simplified to the reorganization of the corresponding pixel set. arrangement. Two photos with partial overlap can be matched in the computer first, the overlapping positions are located, and then the content is continuously spliced into a larger photo. In this way, the imaging field of view can be expanded and the image quality can be improved without changing the imaging equipment. The disadvantage of this solution is that it is offline and non-real-time: The user first takes multiple photos in succession using a conventional camera, and then inputs the photos to a computer for sorting, matching, and splicing. This inevitably results in a long processing cycle and troublesome operation, once individual photos do not meet The request will cause the entire splicing to fail, and the user needs to retake and repeat the above operation. The main purpose of today's digital cameras is shooting and storage. The basic structure is shown in Figure 1. It includes a module 21, a control module 22, a storage module 23, and of course, a power module or the like not shown in the figure. The imaging module 11 includes a photoelectric image sensor and a sensor signal processor for performing photoelectric signal conversion and processing of the image, and converting the data into a data format acceptable to the back-end integrated circuit. Control module 12 performs storage of image data in storage module 13 and communication with the computer. The solution is simple and economical, and it can meet the needs of users to take a single photo and save it. However, the above structure does not have a device or a component for real-time processing of multiple image stitching, and thus cannot meet the requirements of on-site panoramic photographing. Summary of the invention
针对现有技术的上述缺陷， 本发明要解决主要问题是克服现有便携相机成 像视野受限的缺点 , 提供一种具有全景拍摄功能的数字便携式拍照设备。  In view of the above-mentioned drawbacks of the prior art, the main problem to be solved by the present invention is to overcome the shortcomings of the limited field of view of the existing portable camera, and to provide a digital portable photographing apparatus having a panoramic photographing function.
本发明的技术方案是： 一种具有全景拍摄功能的数字便携式拍照设备， 它 包括控制模块、 数字成 ^ 莫块、 以及用于存储所拍摄照片的照片存储模块， 所 述的控制模块分别和数字成像模块、 照片存储模块进行电连接； 第一緩冲存储 器用于存储主体照片； 第二緩冲存储器用于存储后接照片； 用于对所述后接照 片与主体照片之间的重叠区状况进行分析的图像匹配模块； 以及， 根据所述图 像匹配模块的输出结果，对所述后接照片与主体照片进行拼接以生成全景照片， 并将该全景照片暂存到所述第一緩冲存储器或第二緩冲存储器中的图像拼接模 块；  The technical solution of the present invention is: a digital portable photographing device having a panoramic photographing function, comprising a control module, a digital module, and a photo storage module for storing the photographed photograph, the control module and the number respectively The imaging module and the photo storage module are electrically connected; the first buffer memory is used to store the photo of the main body; the second buffer memory is used to store the post photo; and the overlapping area between the rear photo and the main photo is used. Performing an image matching module for analyzing; and, according to an output result of the image matching module, splicing the subsequent photo with the main body photo to generate a panoramic photo, and temporarily storing the panoramic photo to the first buffer memory Or an image splicing module in the second buffer memory;
在控制模块的控制下， 本发明的拍照设备可工作于普通拍摄模式和连续拍 摄模式， 在连续拍摄模式时， 先根据使用者输入的指令拍摄第一张照片， 并将 其作为主体照片暂存； 再根据使用者输入的指令拍摄下一张照片， 并将其作为 后接照片暂存； 再由图像匹配模块对所述后接照片与主体照片之间的重叠区状 态进行分析， 包括是否有重叠， 重叠范围大小等； 然后由图像拼接模块根据后 接照片与主体照片之间的重叠区状态， 将两者拼为一伥连续一体的新照片， 并 将其作为新的主体照片到所述第一緩冲存储器中； 拍完之后， 再将最后的主体 照片作为全景照片保存到照片存储模块。 Under the control of the control module, the photographing device of the present invention can work in the normal shooting mode and the continuous shooting mode. In the continuous shooting mode, the first photo is taken according to the instruction input by the user, and is temporarily stored as the main photo. Then, according to the instruction input by the user, the next photo is taken and temporarily stored as a subsequent photo; and the image matching module analyzes the state of the overlapping area between the subsequent photo and the main photo, including whether there is Overlap, overlap range size, etc.; then by image stitching module based on The state of the overlapping area between the photo and the main photo is taken, and the two are combined into a continuous new photo, and taken as a new main photo into the first buffer memory; after the shooting, the last The main photo is saved as a panoramic photo to the photo storage module.
本发明将实时处理及智能识别技术引入拍照设备， 采用人机配合方式完成 主动取景、 连续拍摄及智能拼接， 形成一种新颖实用的现场全景拍照设备： 对 使用者拍得的照片现场进行智能拼接， 达到 "即拍即拼， 拍完即现"。 本发明不 需要采用任何额外附加的机械或光学设备， 小巧便携， 保持通常的手工拍摄习 惯； 本发明不要求操作者必须很精确地旋转拍照设备， 方便使用， 具有现场成 像的优点。 附图说明  The invention introduces real-time processing and intelligent recognition technology into the photographing device, adopts human-machine cooperation to complete active framing, continuous shooting and intelligent splicing, and forms a novel and practical on-site panoramic photographing device: intelligently splicing the photos taken by the user , to achieve "immediately shoot, fight, and shoot." The present invention does not require any additional mechanical or optical equipment, is small and portable, and maintains the usual manual shooting habits; the present invention does not require the operator to rotate the photographing apparatus very accurately, is convenient to use, and has the advantage of on-site imaging. DRAWINGS
图 1为传统数码相机的原理框图；  Figure 1 is a schematic block diagram of a conventional digital camera;
图 2为本发明一个实施例的原理框图；  2 is a schematic block diagram of an embodiment of the present invention;
图 3为本发明另一实施例的原理框图；  3 is a schematic block diagram of another embodiment of the present invention;
图 4为本发明又一实施例的原理框图；  4 is a schematic block diagram of still another embodiment of the present invention;
图 5为本发明一实施例中所采用的 5向键的实例图；  Figure 5 is a diagram showing an example of a 5-way key used in an embodiment of the present invention;
图 6为图 2中所示本发明数码相机的电路图；  Figure 6 is a circuit diagram of the digital camera of the present invention shown in Figure 2;
图 7为利用本发明的相机进行连续全景拍摄时的流程图；  Figure 7 is a flow chart when continuous panoramic shooting is performed using the camera of the present invention;
图 8为本发明进行全景拍摄的第一幅照片；  Figure 8 is a first photograph of a panoramic shot taken in accordance with the present invention;
图 9为本发明进行全景拍摄的第二幅照片；  Figure 9 is a second photograph of a panoramic shot of the present invention;
图 10为图 8、 9进行拼接时的重叠部分示意图；  Figure 10 is a schematic view showing the overlapping portion when the splicing is performed in Figures 8 and 9;
图 11为将图 8、 9拼接好以后的全景照片。 具体实施方式  Figure 11 is a panoramic photograph of Figure 8 and Figure 9. detailed description
下面将结合附图及实施例对本发明作进一步说明。  The invention will now be further described with reference to the drawings and embodiments.
本发明的一个实施例如图 2所示， 从图中可以看出， 本实施例是对图 1中 所示数码相机的改进。 其中除了普通数码相机中相互联接的数字成像模块 21、 控制模块 22和照片存储模 23之外， 还包括第一緩冲存储器 25、 第二緩冲存储 器 26、 图像匹配模块 27、 以及图像拼接模块 28。 An embodiment of the present invention is shown in FIG. 2. As can be seen from the figure, the embodiment is in FIG. The improvement of the digital camera shown. The first buffer memory 25, the second buffer memory 26, the image matching module 27, and the image splicing module are included in addition to the digital imaging module 21, the control module 22, and the photo storage module 23 connected to each other in the ordinary digital camera. 28.
其中， 图像匹配模块 27和图像拼接模块 28可集成到一个数字处理器中， 该数字处理器可以是专用处理器、 可编程处理器、 或采用动态重配置技术的通 用集成电路。 第一緩冲存储器 25和第二緩冲存储器 26可是以同一緩冲存储器 的两个存储区； 第一緩冲存储器 25和第二緩冲存储器 26也可以分别是各自独 立的緩冲存储器， 或者分別由一个以上的緩冲存储器组合而成。 第一緩冲存储 器 25和第二緩冲存储器 26的构成， 可具体根据所要存储的照片数据容量以及 照片数据格式、 照片数据大小以及设计时所采用的存储芯片来确定。 这些确定 方法具体可由设计人员根据设计要求和相关的存储芯片技术手册进行， 属于本 领域技术人员的常用技术手段， 在此不再赘述。  The image matching module 27 and the image splicing module 28 can be integrated into a digital processor, which can be a dedicated processor, a programmable processor, or a general-purpose integrated circuit using dynamic reconfiguration technology. The first buffer memory 25 and the second buffer memory 26 may be two storage areas of the same buffer memory; the first buffer memory 25 and the second buffer memory 26 may also be independent buffer memories, respectively, or Each is composed of more than one buffer memory. The configuration of the first buffer memory 25 and the second buffer memory 26 can be specifically determined according to the photo data capacity to be stored and the photo data format, the photo data size, and the memory chip used in the design. These determination methods may be specifically performed by the designer according to the design requirements and the related memory chip technical manual, and are common technical means of those skilled in the art, and are not described herein again.
本实施例的数码相机可工作于普通拍摄模式或全景拍摄模式。 普通拍摄模 式等同于传统拍照， 即拍摄一张， 保存一张。 在全景拍摄模式时， 先根据使用 者输入的指令拍摄第一张照片， 并将其作为主体照片暂存到第一緩冲存储器 25 中； 再根据使用者输入的指令拍摄下一张照片， 并将其作为后接照片暂存到第 二緩冲存储器 26中； 再由图像匹配模块 27对后接照片与主体照片之间的重叠 区状态进行分析， 包括是否有重叠， 重叠范围大小等； 然后由图像拼接模块 28 对后接照片与主体照片之间的重叠区进行拼合处理， 拼接出一张连续一体的新 照片， 并将其作为新的主体照片放到第一緩冲存储器 25中； 拍完之后， 畀将最 后的主体照片作为全景照片保存到存储模块 23中。  The digital camera of the embodiment can operate in a normal shooting mode or a panoramic shooting mode. The normal shooting mode is equivalent to the traditional photo taking, that is, taking one picture and saving one. In the panoramic shooting mode, the first photo is taken according to the instruction input by the user, and is temporarily stored as a main photo in the first buffer memory 25; then the next photo is taken according to the instruction input by the user, and The image is temporarily stored in the second buffer memory 26; the image matching module 27 analyzes the state of the overlapping area between the subsequent photo and the main photo, including whether there is overlap, overlapping range size, etc.; The image splicing module 28 performs a splicing process on the overlapping area between the contiguous photo and the main photo, splicing out a continuous new photo, and placing it as a new main photo in the first buffer memory 25; After that, the last subject photo is saved to the storage module 23 as a panoramic photo.
参见图 3, 本发明还包括用于显示所拍摄照片的显示单元 29 , 所述控制模 块 22和该显示单元 29连接， 该控制单元根据拍照设备上设置的显示按键的状 态控制该显示单元 29显示或停止显示。  Referring to FIG. 3, the present invention further includes a display unit 29 for displaying a photograph taken, the control module 22 is connected to the display unit 29, and the control unit controls the display unit 29 to display according to the state of the display button provided on the photographing device. Or stop showing.
参见图 4 , 在上述的实施例基础上， 还可以进一步设置播放模块 291, 该播 放模块 291和控制模块 22连接， 并可以和图像匹配模块 27和图像拼接模块 28 一同集成到数字处理器中。在控制模块 22的控制下，播放模块 291从和其连接 的第一、 第二緩冲存储器或照片存储模块中提取全景照片， 并对其进行番放。 Referring to FIG. 4 , based on the foregoing embodiment, a play module 291 may be further provided. The play module 291 is connected to the control module 22, and may be combined with the image matching module 27 and the image splicing module 28. Integrated into the digital processor. Under the control of the control module 22, the playback module 291 extracts a panoramic photo from the first or second buffer memory or photo storage module connected thereto, and performs the panning.
为了使观看者能够是对播放操作进行控制， 在所述拍照设备上进一步设置 控制播放的按钮 292 , 这些按钮 292和控制模块 22连接， 当这些按钮 292被按 下时，所述的控制模块 22采集到相应的按钮信号， 然后将这些信号传送给播放 模块 291 , 播放模块 291接收到所述的按扭信号后， 根据相应的信号， 对全景 照片的播放进行调整， 例如， 在接收到向左移动按钮信号时， 播放模块 291将 当前在显示单元 29 中显示的照片内容， 用向左移动一个步长的照片内容来替 换， 达到， 照片左移显示的效果； 同样， 在接收到向右、 上、 下移动按鈕信号 时， 也对应着相应的操作。 而接收到停止按键信号时， 则固定显示当前正在显 示内容。  In order to enable the viewer to control the playing operation, buttons 292 for controlling playback are further provided on the photographing device, and the buttons 292 are connected to the control module 22, and when the buttons 292 are pressed, the control module 22 Collecting corresponding button signals, and then transmitting the signals to the playing module 291. After receiving the button signal, the playing module 291 adjusts the playing of the panoramic photo according to the corresponding signal, for example, receiving the leftward When the button signal is moved, the playing module 291 replaces the photo content currently displayed in the display unit 29 with the photo content shifted to the left by one step, and the effect of moving the photo to the left is achieved; likewise, when receiving the rightward, When the button signal is moved up and down, it also corresponds to the corresponding operation. When the stop button signal is received, the content currently being displayed is fixedly displayed.
为了更加方便全景照片的浏览者， 在所述的拍照设备上， 还可以进一步设 置控制播放速度调节信号的调速按钮， 该调速按钮同样和控制模块 22连接， 当 播放模块 291接收到由控制模块 22转发的调速信号时，对当前全景图像的移动 速度进行相应的调整， 直到观看者满意。  In order to further facilitate the viewer of the panoramic photo, on the photographing device, a speed control button for controlling the play speed adjustment signal may be further provided, and the speed control button is also connected to the control module 22, and when the play module 291 receives the control When the speed adjustment signal is forwarded by the module 22, the moving speed of the current panoramic image is adjusted accordingly until the viewer is satisfied.
另外， 在所述的显示单元 29 中可以设置用于动态地回放照片存储模块 23 中全景照片的时钟和位置计数器， 并且在该位置计数器的基础上， 自动滚动显 示大幅面的全景照片， 同时也可响应用户的 "上、 下、 左、 右、 停" 等按键操 作即时改变显示状态。 图 5给出了一个所述 5向键的实例图， 其中包括向上键 31 , 向下键 32， 向左键 33 , 向右键 34和停止键 35。 这些键分别将其输出与控 制模块 22相连接， 用于将按键信号传送给所的控制模块 22。 由于上数的连接 属于本领与技术人员的基本技能， 故在图 6中并未直接给出。  In addition, a clock and a position counter for dynamically playing back the panoramic photo in the photo storage module 23 may be disposed in the display unit 29, and based on the position counter, automatically scrolling to display a large-format panoramic photo, and also The display status can be changed in real time in response to the user's "up, down, left, right, stop" and other key operations. Fig. 5 shows an example of the five-way key, which includes an up key 31, a down key 32, a left key 33, a right key 34 and a stop key 35. These keys respectively connect their outputs to the control module 22 for transmitting the key signals to the control module 22. Since the connection of the upper number is a basic skill of the skill and the technician, it is not directly shown in Fig. 6.
参见图 6 , 在本发明的一个优选实施例中 , 上述成像模块 21采用单片高分 辨数字摄像芯片 OV7620, 控制模块 22采用芯片 OV681 , 存储模块 23采用 CMOS FLASH存储器 AM29LV160D, 集成有图像匹配模块 27和图像拼接模块 28功能的 数字处理器采用 MC68VZ328 , 并用 SDRAM HYB39S6416A作为緩冲存储器 25、 26。 在上述实施例中， OV7620包括光电图像传感器和传感器信号处理器， 用来 完成图像的光电信号转换及处理工作， 将其转换为 AM29LV160D, HYB39S6416A 及 MC68VZ328可以接受的数据格式。 0V681控制图像数据在 AM29LV160D中的存 储及与 MC68VZ328的通信。 MC68VZ328为可编程数字处理器， 通过编程具有图 像匹配和图像拼接功能模块。 HYB39S6416A通过寻址空间的设定被 MC68VZ328 分为两个数据緩冲空间， 作为用于存储主体照片的第一緩冲存储器和用于存储 后接照片的第二緩冲存储器。 Referring to FIG. 6, in a preferred embodiment of the present invention, the imaging module 21 uses a single-chip high-resolution digital camera chip OV7620, the control module 22 uses a chip OV681, and the storage module 23 uses a CMOS FLASH memory AM29LV160D, and an image matching module 27 is integrated. The digital processor functioning with the image splicing module 28 uses the MC68VZ328 and uses the SDRAM HYB39S6416A as the buffer memory 25, 26. In the above embodiment, the OV7620 includes a photoelectric image sensor and a sensor signal processor for performing photoelectric signal conversion and processing of the image, and converting it into an acceptable data format of the AM29LV160D, HYB39S6416A and MC68VZ328. 0V681 controls the storage of image data in the AM29LV160D and communication with the MC68VZ328. The MC68VZ328 is a programmable digital processor that is programmed with image matching and image stitching modules. The HYB39S6416A is divided into two data buffer spaces by the MC68VZ328 through the setting of the address space, as a first buffer memory for storing a subject photo and a second buffer memory for storing a subsequent photo.
如图 6 所示为图 2 中所示数码相机的电路图， 其中示出了 MC68VZ328 与 HYB39S6416A和 AM29LV160D之间的电连接关系。  Figure 6 shows the circuit diagram of the digital camera shown in Figure 2, which shows the electrical connection between the MC68VZ328 and the HYB39S6416A and AM29LV160D.
本发明可工作于普通拍摄模式和连续拍摄模式， 在连续拍摄模式时， 可按 图 7所示的流程工作。  The present invention can operate in the normal shooting mode and the continuous shooting mode, and in the continuous shooting mode, can operate in the flow shown in FIG.
(1) 使用者根据需要拍摄的全景范围， 先对准第一个取景范围， 如果是按 由左至右的方式拍摄， 则先对准最左边的取景范围， 当然， 也可按由右至左、 由上至下、 或由下至上的方式进行拍摄； 此时， 相机的拍摄镜头所对准的取景 范围的图像将会传送到显示器进行实时显示， 以供使用者判断是否对准了所需 的取景范围， 并进行相应的调整的；  (1) The user should first aim at the first viewing range according to the panoramic range that needs to be shot. If shooting from left to right, first align with the leftmost viewing range. Of course, you can also press right to Shooting left, top to bottom, or bottom to top; at this point, the image of the framing range that the camera's shooting lens is aimed at will be transmitted to the display for real-time display, for the user to determine whether it is aligned The required range of view and corresponding adjustments;
(2) 当确定了第一张照片的取景范围之后， 使用者通过按下拍摄键， 即可 拍摄第一张照片， 此时会将拍摄镜头当前所对准的取景范围的场景被 OV7620 成像并通过 0V681和 MC68VZ328控制作为主体照片保存到 HYB39S6416A中的第 一緩冲存储器中， 同时自动进入下一次取景状态。  (2) After determining the framing range of the first photo, the user can take the first photo by pressing the capture button, and the scene of the framing range to which the photographic lens is currently aimed is imaged by the OV7620. The 0V681 and MC68VZ328 control are saved as the main picture to the first buffer memory in the HYB39S6416A, and the next framing state is automatically entered.
(3) 使用者适当旋转拍摄镜头或自身身体， 准备拍摄下一张照片， 同样， 相机的拍摄镜头所对准的取景范围的图像将会传送到显示器进行实时显示。  (3) The user rotates the shooting lens or his body properly to prepare for the next photo. Similarly, the image of the viewing range to which the camera's shooting lens is aimed is transmitted to the display for real-time display.
(4) MC68VZ328 中的图像匹配模块实时判断拍摄鏡头当前所对.准的取景范 围的图像与当前主体照片之间的重叠范围（如图 10中所示），计算出当前重叠区 面积占整个图像面积的比例； 若发现重叠区大于 25%, 则发出向右旋转提示信 号， 以减小重叠； 若发现重叠区小于 15%, 则发出向左旋转提示信号， 以增大 重叠； 当重叠比例为 20%左右（15- 25%之间）时， 则发出拍摄提示信号， 提示使 用者此时为最佳拍摄范围。 这里的提示信号可以是由显示器所显示出的图标或 文字、 由发声器件所发出的声音、 或者是由发光器件所发出的灯光。 (4) The image matching module in the MC68VZ328 determines in real time the overlap range between the image of the current framing range and the current subject photo (as shown in Figure 10), and calculates the current overlapping area as a whole. Ratio of image area; if the overlap area is found to be greater than 25%, a rotation signal to the right is issued to reduce the overlap; if the overlap area is found to be less than 15%, a leftward rotation prompt signal is issued to increase Overlap; When the overlap ratio is about 20% (between 15 and 25%), a shooting alert signal is issued, prompting the user to be the best shooting range at this time. The prompt signal here may be an icon or text displayed by the display, a sound emitted by the sound emitting device, or a light emitted by the light emitting device.
(5) 使用者根据上述提示信号可调整身体角度或拍摄角度， 选择合适场景 即可通过按下拍摄键拍摄一张后接照片， 该照片被保存到 HYB39S6416A中的第 二緩冲存储器中。 _  (5) The user can adjust the body angle or shooting angle according to the above prompt signal, and select a suitable scene to take a follow-up photo by pressing the capture button, and the photo is saved to the second buffer memory in the HYB39S6416A. _
(6) MC68VZ328 中的图像拼接模块自动对上述主体照片和后接照片进行连 续拼接处理， 4并接出一张连续一体的新照片， 并将其作为新的主体照片保存到 HYB39S6416A中的第一緩冲存储器中； 同时自动进入下一次取景状态。  (6) The image splicing module in the MC68VZ328 automatically splicing the above-mentioned main photo and the subsequent photo, 4 and taking out a new continuous photo, and saving it as the new main photo to the first in HYB39S6416A In the buffer memory; at the same time automatically enter the next framing state.
(7)如图 7所示，重复上述步骤（3) - (6) ,当完成了***预定的拼接数量（例 如 5张拼接）或使用者输入结束指令， 此时会将最后生成的主体照片作为全景 照片输出到照片存储模块 AM29LV160D中，或通过标准接口输出到外接于相机的 闪存中， 或输出到其它非易失性存储器中。  (7) As shown in Fig. 7, repeat the above steps (3) - (6), when the system has completed the predetermined number of stitches (for example, 5 stitches) or the user inputs the end command, the last generated body photo will be generated. It is output as a panoramic photo to the photo memory module AM29LV160D, or output to a flash memory external to the camera through a standard interface, or output to other non-volatile memory.
(8) 全景拍摄完毕， 显示器会自动滚动显示该全景照片， 同时响应用户的 按键控制。 如果用户按下图 5中的向左键 33, ***向左滚动显示该照片； 如果 用户按下向右键 34, ***向右滚动显示该照片； 同理实现 "上下左右停" 5种 控制。  (8) When the panorama is finished, the monitor will automatically scroll through the panorama and respond to the user's button controls. If the user presses the left button 33 in Fig. 5, the system scrolls to display the photo to the left; if the user presses the right button 34, the system scrolls to the right to display the photo; similarly, the five controls of "up, down, left, and right" are implemented.
上述步骤（4 )中的图像匹配模块的实现基于数字处理器对图像匹配算法的 软硬件实现。在原理上它由两部分组成， 即内容一致性测量和场景重叠区定位。 当两张照片被数字化成以像素为基本单位的数字集合后 (下文均称数字图像）， 这两张照片的内容比较可转化为相应像素的比较； 因而可以将两张数字图像的 对应像素的平均差异定义为测量图像中内容一致性的一个简单测度， 从数学意 义上讲， 该测度是以这两张数字图像张成的两个矢量的一个距离测度。 当两张 照片的场景差异越小， 也就是说内容越一致， 这两张数字图像的对应像素的平 均差异值越小， 该测度值越小。 该内容一致性测度不仅适用于两张数字图像的 整体一致性测量， 也可推广到其局部性测量。 例如两张照片仅局部内容重叠， 则在内容真实重叠情况下的重叠区内统计对应像素的平均差异，该差异值很小； 相反， 但对于其它重叠位置， 对应的内容不一样， 其基于像素差异的统计平均 值^大， 因而该内容一致性测度值变大。 利用该特性， 我们使用内容一致性测 度来自动定位场景重叠区： 首先计算两张照片在候选的重叠位置下的内容一致 性测度值； 选出最小的内容一致性测度值， 取得该值时的重叠位置即为这两张 图像的准确场景重叠位置。 The implementation of the image matching module in the above step (4) is based on the hardware and software implementation of the image matching algorithm by the digital processor. In principle, it consists of two parts, namely content consistency measurement and scene overlap area positioning. When two photos are digitized into a set of numbers based on pixels (hereinafter referred to as a digital image), the content comparison of the two photos can be converted into a comparison of the corresponding pixels; thus, the corresponding pixels of the two digital images can be The average difference is defined as a simple measure of the consistency of the content in the image. In mathematical terms, the measure is a distance measure of the two vectors that are formed by the two digital images. When the difference between the scenes of the two photos is smaller, that is to say, the more consistent the content, the smaller the average difference value of the corresponding pixels of the two digital images, the smaller the measure value. This content consistency measure applies not only to the overall consistency measurement of two digital images, but also to its locality measurements. For example, two photos only have partial content overlap. Then, the average difference of the corresponding pixels is counted in the overlapping area in the case where the content is actually overlapped, and the difference value is small; on the contrary, for other overlapping positions, the corresponding content is different, and the statistical average value based on the pixel difference is large, thus The content consistency measure value becomes larger. Using this feature, we use the content consistency measure to automatically locate the scene overlap area: first calculate the content consistency measure value of the two photos in the candidate overlap position; select the smallest content consistency measure value, when the value is obtained The overlapping position is the exact scene overlap position of the two images.
可见，上述图像匹配算法用于自动准确地定位出两张照片的场景重叠位置。 基于此， 本发明所述的图像拼接模块也就简化为两个图像相应像素集合的重组 和排列： 在重叠区内选择线性加权法设定在新合成图像中的重叠位置处的像素 值， 在重叠区外保留原图像的对应像素值。  It can be seen that the above image matching algorithm is used to automatically and accurately locate the scene overlapping positions of the two photos. Based on this, the image splicing module of the present invention is also simplified into the recombination and arrangement of the corresponding pixel sets of the two images: selecting the pixel value at the overlapping position in the newly synthesized image by selecting the linear weighting method in the overlap region, The corresponding pixel value of the original image is retained outside the overlap area.
需要注意的是： 本发明要求拍摄的照片之间要有一定的重叠区， 其目的仅 是为了给图像拼接模块以足够和准确的图像数据， 用于完成连续完整的图像拼 接。 在实际使用中， 相邻照片之间的重叠越多， 匹配信息越多但幅面扩展效率 越低； 相反， 相邻照片之间的重叠越少， 指导图像拼接的数据也相应减少， 可 能会影响图像拼接的准确度。 兼顾拍摄效率和拼接性能， 在本发明的上述实施 例中选择 20%为推荐的重叠区。  It should be noted that the present invention requires a certain overlap between the photographs taken, and the purpose is only to provide sufficient and accurate image data for the image stitching module to complete a continuous and complete image stitching. In actual use, the more overlap between adjacent photos, the more matching information, but the lower the expansion efficiency; on the contrary, the less overlap between adjacent photos, the less the data guiding the image stitching, which may affect The accuracy of image stitching. Considering the shooting efficiency and the splicing performance, 20% is selected as the recommended overlap area in the above embodiment of the present invention.
利用本发明的全景拍照数码相机， 使用者通过调整自身位置或相机角度， 连续拍摄的多张照片可被机器自动地拼接成一张大照片， 如图 8-11所示，从而 起到扩大成像视野的作用。 其中， 图 8为第一幅照片， 图 9为本发明拍摄的第 二幅照片， 从图 8、 9可以看出： 图 8的右侧一部分图像和图 9左侧的一部分图 像是基本上一样的。 在拼接时， 参见图 10, 将图 8、 9 中基本上为相同的图像 相互重叠， 最后生成如图 11所示的全景图像。 实际使用中， 本设备可拍摄 360 度环绕的全景照片， 超越其物理镜头的限制， 图像现场生成。 所得图像连续完 整， 内容丰富， 视觉质量明显优于普通相机拍摄的单张画面。 基于上述方案， 本发明替代了传统的冲印、 剪裁、 粘贴等一系列繁瑣手工操作以及计算机上的 特别处理， 操作简洁， 效果明显。 本发明的方案不仅适用于数码相机， 还可适用于具有拍摄功能的手机及其 他便携式数码摄影设备。 其前提是要在数码相机或其他便携数码式摄影设备中 增加具有图像匹配模块、 图像拼接模块和播放模块的数字处理器、 以及用于实 现緩存的数据緩冲器。 的技术方案； 因此， 尽管本说明书参照上述的各个实施例对本发明已进行了详 细的说明， 但是， 本领域的普通技术人员应当理解， 仍然可以对本发明进行修 改或者等同替换； 而一切不脱离本发明的精神和范围的技术方案及其改进， 其 均应涵盖在本发明的权利要求范围当中。 With the panoramic camera digital camera of the present invention, the user can automatically splicing a plurality of photos continuously into a large photo by adjusting the position of the camera or the camera angle, as shown in FIG. 8-11, thereby expanding the imaging field of view. effect. 8 is a first photograph, and FIG. 9 is a second photograph taken by the present invention. As can be seen from FIGS. 8 and 9, a portion of the image on the right side of FIG. 8 and a portion of the image on the left side of FIG. 9 are substantially the same. of. At the time of splicing, referring to Fig. 10, substantially the same images in Figs. 8 and 9 are overlapped with each other, and finally a panoramic image as shown in Fig. 11 is generated. In actual use, the device can take 360-degree panoramic photos, beyond the limits of its physical lens, and the images are generated on-site. The resulting image is continuous and complete, rich in content, and the visual quality is significantly better than that of a single camera. Based on the above scheme, the present invention replaces a series of complicated manual operations such as printing, cutting, and pasting, as well as special processing on a computer, and the operation is simple and the effect is obvious. The solution of the present invention is applicable not only to digital cameras, but also to mobile phones and other portable digital photography devices having shooting functions. The premise is to add a digital processor with an image matching module, an image stitching module and a playback module, and a data buffer for implementing the buffer in a digital camera or other portable digital photography device. The present invention has been described in detail with reference to the various embodiments described above, but those skilled in the art will understand that the invention may be modified or equivalently substituted. The spirit and scope of the invention and its modifications are intended to be included within the scope of the appended claims.

Claims

权利 要求 Rights request
1、 一种具有全景拍摄功能的数字便携式拍照设备， 包括控制模块、数字成 像模块、 以及用于存储所拍摄照片的照片存储模块， 所述的控制模块分别和数 字成 ^ 莫块、 照片存储模块进行电连接， 其特征在于：  A digital portable photographing device having a panoramic photographing function, comprising a control module, a digital imaging module, and a photo storage module for storing photographs taken, wherein the control module and the digital module and the photo storage module respectively Electrical connection is characterized by:
还包括用于存储主体照片的第一緩冲存储器； 用于存储后接照片的第二緩 冲存储器； 用于对所述后接照片与主体照片之间的重叠区状况进行分析的图像 匹配模块； 以及， 根据所述图像匹配模块的输出结果， 对所述后接照片与主体 照片进行拼接以生成全景照片， 并将其暂存到所述第一緩冲存储器或第二緩冲 存储器中的图像拼接模块；  Also included is a first buffer memory for storing a photo of the subject; a second buffer memory for storing the succeeding photo; an image matching module for analyzing an overlap region condition between the subsequent photo and the subject photo And splicing the following photo with the subject photo to generate a panoramic photo and temporarily storing the same in the first buffer memory or the second buffer memory according to an output result of the image matching module Image splicing module;
所述控制模块还连接并控制所述第一、 第二緩冲存储器、 图像匹配模块及 图像拼接模块的工作状态， 并将最后生成的全景照片保存到所述照片存储模块 中。 .  The control module further connects and controls the working states of the first and second buffer memories, the image matching module and the image splicing module, and saves the last generated panoramic photo to the photo storage module. .
2、根据权利要求 1所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于： 所述第一、 第二緩冲存储器是同一緩冲存储器中的两个存储区， 或者 分别是各自独立的緩冲存储器， 或者分别由一个以上的緩冲存储器组合而成。  2. The digital portable photographing apparatus with panoramic photographing function according to claim 1, wherein: said first and second buffer memories are two storage areas in the same buffer memory, or are respectively independent. The buffer memory, or a combination of more than one buffer memory.
3、根据权利要求 1所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于： 所述图像匹配模块和图像拼接模块集成到同一个数字处理器中， 所述 数字处理器可以是专用处理器、 可编程处理器， 或采用动态重配置技术的通用 集成电路。  3. The digital portable photographing apparatus with panoramic photographing function according to claim 1, wherein: the image matching module and the image stitching module are integrated into a same digital processor, and the digital processor can be dedicated processing. , programmable processor, or general purpose integrated circuit with dynamic reconfiguration technology.
4、根据权利要求 1或 2或 3所述的具有全景拍摄功能的数字便携式拍照设 备， 其特征在于： 所述控制模块连接有用于显示所拍摄照片的显示单元， 该控 制单元根据拍照设备上设置的显示按键的状态控制该显示单元显示或停止显示 照片。 The digital portable photographing apparatus with panoramic photographing function according to claim 1 or 2 or 3, wherein: the control module is connected with a display unit for displaying the photographed photograph, and the control unit is configured according to the photographing device. The status of the display button controls whether the display unit displays or stops displaying Photo.
5、根据权利要求 4所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于： 所述控制模块还连接有播放模块， 该播放模块还和第一、 第二緩冲存 储器或照片存储模块连接， 并在控制模块的控制下从第一、 第二緩冲存储器或 照片存储模块中提取并在显示单元上进行播放全景照片。  The digital portable photographing device with panoramic photographing function according to claim 4, wherein: the control module is further connected with a play module, and the play module is further connected to the first and second buffer memories or the photo storage module. Connected, and extracted from the first, second buffer memory or photo storage module under the control of the control module and playing a panoramic photo on the display unit.
6、根据权利要求 5所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于： 所述播放模块直接集成到数字处理器中。  A digital portable photographing apparatus having a panoramic photographing function according to claim 5, wherein: said play module is directly integrated into the digital processor.
7、根据权利要求 5所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于， 所述拍照设备上进一步设置一个以上用于输入全景照片播放控制信号 的按钮， 该按狃与所述的控制模块连接， 并经控制模块将所述的播放控制信号 传送给播放模块。  The digital portable photographing device with panoramic photographing function according to claim 5, wherein the photographing device further comprises one or more buttons for inputting a panoramic photo playback control signal, the button and the The control module is connected, and the play control signal is transmitted to the play module via the control module.
8、根据权利要求 7所述的具有全景拍摄功能的数字便携式拍照设备， 其特 征在于： 所述的按钮至少包括用于输入播放方向控制信号的、 具有 "上、 下、 左、 右、 停" 5个操作模式的 5向按键或 5向操纵杆。  8. The digital portable photographing apparatus with panoramic photographing function according to claim 7, wherein: said button includes at least "upper, lower, left, right, stop" for inputting a play direction control signal. 5-way button or 5-way joystick for 5 operating modes.
9、根据权利要求 8所述的具有全景拍摄功能的数字便携式拍照设备，其特 征在于：所述的按钮还进一步包括用于输入控制播放速度调节信号的调速按鈕。  A digital portable photographing apparatus having a panoramic photographing function according to claim 8, wherein said button further comprises a speed control button for inputting a control of a playback speed adjustment signal.
10、 根据权利要求 4所述的具有全景拍摄功能的数字便携式拍照设备， 其 特征在于， 所述显示单元中设有用于滚动显示全景照片的时钟和位置计数器。  10. The digital portable photographing apparatus with panoramic photographing function according to claim 4, wherein the display unit is provided with a clock and a position counter for scrolling and displaying the panoramic photograph.
11、 根据权利要求 1所述的具有全景拍摄功能的数字便携式拍照设备， 其 特征在于： 所述数字便携式拍照设备中还设有移动通信模块， 该移动通信模块 和所述的控制模块连接， 构成具有全景拍摄功能的移动通信终端。  The digital portable photographing device with panoramic photographing function according to claim 1, wherein: the digital portable photographing device further comprises a mobile communication module, wherein the mobile communication module is connected with the control module, and constitutes A mobile communication terminal having a panoramic shooting function.
PCT/CN2004/000804 2004-07-14 2004-07-14 A portable panoramic photographic apparatus WO2006005231A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2004/000804 WO2006005231A1 (en) 2004-07-14 2004-07-14 A portable panoramic photographic apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2004/000804 WO2006005231A1 (en) 2004-07-14 2004-07-14 A portable panoramic photographic apparatus

Publications (1)

Publication Number Publication Date
WO2006005231A1 true WO2006005231A1 (en) 2006-01-19

Family

ID=35783500

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2004/000804 WO2006005231A1 (en) 2004-07-14 2004-07-14 A portable panoramic photographic apparatus

Country Status (1)

Country Link
WO (1) WO2006005231A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9106872B2 (en) * 2008-10-27 2015-08-11 Sony Corporation Image processing apparatus, image processing method, and program
CN106934762A (en) * 2017-03-09 2017-07-07 史鹏飞 A kind of image split-joint method and equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000023013A (en) * 1998-06-30 2000-01-21 Casio Comput Co Ltd Image pickup device
JP2001230963A (en) * 2000-02-17 2001-08-24 Ribaaberu:Kk Image pickup device
CN1452730A (en) * 2000-03-22 2003-10-29 爱格斯露申光电子有限公司 Panoramic image acquisition device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000023013A (en) * 1998-06-30 2000-01-21 Casio Comput Co Ltd Image pickup device
JP2001230963A (en) * 2000-02-17 2001-08-24 Ribaaberu:Kk Image pickup device
CN1452730A (en) * 2000-03-22 2003-10-29 爱格斯露申光电子有限公司 Panoramic image acquisition device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9106872B2 (en) * 2008-10-27 2015-08-11 Sony Corporation Image processing apparatus, image processing method, and program
CN106934762A (en) * 2017-03-09 2017-07-07 史鹏飞 A kind of image split-joint method and equipment
CN106934762B (en) * 2017-03-09 2020-08-04 北京星云环影科技有限责任公司 Image splicing method and device

Similar Documents

Publication Publication Date Title
WO2021175269A1 (en) Image processing method and mobile terminal
JP5005829B2 (en) Digital camera using multiple lenses
JP6192940B2 (en) Photography equipment and cooperative photography method
JPH09322060A (en) Image pickup device, image composing device and image composition system
JP2023551844A (en) Photography methods, photographic equipment and electronic equipment
JPH10240436A (en) Information processor and recording medium
US20110157394A1 (en) Image processing apparatus, image processing method and program
WO2022262720A1 (en) Photographing method and device
WO2022252660A1 (en) Video capturing method and electronic device
KR20110047613A (en) Method and Apparatus for guiding the photographing
WO2022237839A1 (en) Photographing method and apparatus, and electronic device
JP2002064738A (en) Electronic camera
WO2005003857A1 (en) A method of digital imaging device’s scene panoramic imagery and display method thereof
WO2023231869A1 (en) Photographing method and apparatus
KR100943548B1 (en) Method and apparatus for pose guide of photographing device
JP2010268019A (en) Photographing apparatus
CN106791390A (en) Wide-angle auto heterodyne live preview method and user terminal
TW202145774A (en) Camera capable of selectively displaying 360-degree panoramic images
US20020024608A1 (en) Information processing apparatus and recording medium
WO2021185374A1 (en) Image capturing method and electronic device
US11762175B2 (en) Methods and apparatus for seamless transitions between lens projections
WO2023098638A1 (en) Image sensor, photographic module, electronic device and photographing method
WO2006005231A1 (en) A portable panoramic photographic apparatus
KR101009832B1 (en) Method and apparatus for compounding taken image in digital camera
CN109889751B (en) Portable shooting and recording device for speech content based on optical zooming

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 69(1) EPC, OUR COMMUNICATION OF 04.05.07(EPO FORM 1205A).

122 Ep: pct application non-entry in european phase

Ref document number: 04738402

Country of ref document: EP

Kind code of ref document: A1