WO2022105584A1 - 基于大屏创建全景图片的方法、装置、智能终端及介质 - Google Patents
基于大屏创建全景图片的方法、装置、智能终端及介质 Download PDFInfo
- Publication number
- WO2022105584A1 WO2022105584A1 PCT/CN2021/127958 CN2021127958W WO2022105584A1 WO 2022105584 A1 WO2022105584 A1 WO 2022105584A1 CN 2021127958 W CN2021127958 W CN 2021127958W WO 2022105584 A1 WO2022105584 A1 WO 2022105584A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- resolution
- screen
- picture
- floating window
- window layer
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000005516 engineering process Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 9
- 230000002194 synthesizing effect Effects 0.000 claims description 9
- 230000015572 biosynthetic process Effects 0.000 claims description 6
- 238000003786 synthesis reaction Methods 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000004091 panning Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005429 filling process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/62—Semi-transparency
Definitions
- the present application relates to the technical field of smart large screens, and in particular to a method, device, smart terminal and medium for creating a panoramic picture based on a large screen.
- 360-degree panoramic images are also called three-dimensional panoramic images and panoramic ring views.
- 360-degree panorama technology is a three-dimensional virtual display technology that uses a digital camera to shoot around the existing scene from multiple angles, then uses a computer to stitch it later, and loads a playback program to complete a three-dimensional virtual display technology.
- a method for creating a panoramic image based on a large screen includes:
- the present application provides a device for creating a panoramic picture based on a large screen, including:
- the acquisition module is used to acquire the image resolution of the target image and the screen resolution of the large screen
- the resolution adjustment module is used to calculate the resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain a large-screen image that matches the screen resolution;
- the translation expansion area module is used to create a floating window layer on the large screen image, and configure and fill the translation expansion area corresponding to the category of the screen resolution on the floating window layer through a preset algorithm, and set the translation expansion The layer transparency of the floating window layer corresponding to the area; wherein, the translation expansion area is used to convert the target image into a large-screen image through translation and expansion operations;
- the direct vision module is used for configuring and filling the direct viewing area through the direct viewing algorithm according to the translation expansion area module, and setting the layer transparency of the floating window layer corresponding to the direct viewing area; wherein, The direct viewing area is used to convert large-screen images into panoramic images through parallax;
- the panorama synthesis module is used to synthesize the floating window layer with different layer transparency and the large screen to obtain the panorama of the target image.
- the present application also provides an intelligent terminal.
- the intelligent terminal includes a large-screen display screen, a memory, a processor, and a program for creating a panoramic picture based on the large screen that is stored in the memory and can be run on the processor.
- the processor executes The steps of implementing the method for creating a panoramic picture based on a large screen when a program for creating a panoramic picture based on a large screen is performed.
- the present application also provides a computer storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps in the method for creating a panoramic picture based on a large screen are implemented.
- the present application provides a method, device, intelligent terminal and medium for creating a panoramic picture based on a large screen, aiming to use the resolution difference to generate a large screen image matching the screen resolution from the target picture (ie Planar panorama), and then through the different layer transparency of the floating window layer, the translation expansion area algorithm, the direct view algorithm and the seamless overlay technology, the large-screen image is converted into a three-dimensional panorama, so as to combine the smart large-screen with the
- the combination of VR technology enables the smart large screen to provide a 360° panorama, which improves users' visual experience, expands promotion, and facilitates users.
- FIG. 1 is a flowchart of a method for creating a panoramic picture based on a large screen provided by the application;
- FIG. 2 is a structural block diagram of a device for creating a panoramic picture based on a large screen provided by the application;
- FIG. 3 is a structural block diagram of an intelligent terminal provided by the present application.
- a method for creating a panoramic picture based on a large screen comprising:
- the translation expansion area is used to convert the target picture into the large-screen image through a translation operation and an expansion operation
- the direct view area is used to convert the large-screen image into a panoramic image through parallax
- the floating window layer with different layer transparency is synthesized with the large screen to obtain the panorama of the target picture.
- the picture resolution of the obtained target picture and the screen resolution of the large screen include:
- the picture resolution is expressed as the number of horizontal pixels * the number of vertical pixels of the target picture
- the screen resolution of the large screen is expressed as the number of horizontal pixels * the number of vertical pixels of the large screen.
- the calculating the resolution difference between the picture resolution and the screen resolution includes:
- calculating the resolution difference between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference to obtain a large-screen image matching the screen resolution include:
- the target picture is used as a large-screen picture matching the screen resolution.
- calculating the resolution difference between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference to obtain a large-screen image matching the screen resolution include:
- the absolute value of the horizontal resolution difference is used as the number of pixels to be filled in the horizontal direction of the target picture.
- the absolute value of the horizontal resolution difference is used as the number of pixels to be filled in the horizontal direction of the target picture, including:
- determining the color to be filled and acquiring the color pixel value corresponding to the color to be filled includes:
- the color pixel value of each filling color includes R value, G value and B value;
- the category to which the screen resolution belongs is high-definition resolution, creating a floating window layer on the large-screen image, and configuring and filling the floating window layer on the floating window layer through a preset algorithm
- the translation expansion area and the direct viewing area corresponding to the category to which the screen resolution belongs including:
- a preset direct vision algorithm is added to obtain the first direct vision area; wherein, the first translation expansion area includes the first direct vision area;
- the setting of the layer transparency of the floating window layer corresponding to the translation expansion area and the direct-view area of interest includes:
- synthesizing the floating window layers with different layer transparency and the large screen to obtain the panorama of the target picture including:
- the floating window layers with different layer transparency are synthesized with the large screen to obtain a full high-definition scene image of the target image.
- the category to which the screen resolution belongs is ultra-high-definition resolution
- creating a floating window layer placed on the large-screen image and configuring and filling the floating window layer on the floating window layer through a preset algorithm
- the translation expansion area and the direct viewing area corresponding to the category to which the screen resolution belongs including:
- a preset direct vision algorithm is added to obtain a second direct vision area; wherein, the second translation expansion area includes the second direct vision area;
- the setting of the layer transparency of the floating window layer corresponding to the translation expansion area and the direct-view area of interest includes:
- synthesizing the floating window layers with different layer transparency and the large screen to obtain the panorama of the target picture including:
- the floating window layers with different layer transparency are synthesized with the large screen to obtain an ultra-high-definition panorama of the target image.
- a device for creating a panoramic picture based on a large screen comprising:
- the acquisition module is used to acquire the image resolution of the target image and the screen resolution of the large screen
- a resolution adjustment module is used to calculate the resolution difference between the picture resolution and the screen resolution, and adjust the target picture according to the resolution difference to obtain a large resolution matching the screen resolution. screen image;
- the translation expansion area module is used to create a floating window layer placed on the large-screen image, and configure and fill the translation expansion area corresponding to the category to which the screen resolution belongs on the floating window layer through a preset algorithm. , and set the layer transparency of the floating window layer corresponding to the translation expansion area; wherein, the translation expansion area is used to convert the target picture into the large-screen image through translation and expansion operations. ;
- the direct vision module is used to configure and fill the direct vision area through the direct vision algorithm according to the translation expansion area module, and set the level of the floating window layer corresponding to the direct vision area.
- Layer transparency wherein, the direct-view area of interest is used to convert the large-screen image into a panoramic image through parallax;
- the panorama synthesis module is used for synthesizing the floating window layer with different layer transparency and the large screen to obtain the panorama of the target picture.
- the picture resolution of the obtained target picture and the screen resolution of the large screen include:
- the picture resolution is expressed as the number of horizontal pixels * the number of vertical pixels of the target picture
- the screen resolution of the large screen is expressed as the number of horizontal pixels * the number of vertical pixels of the large screen.
- calculating the resolution difference between the picture resolution and the screen resolution, and adjusting the target picture according to the resolution difference to obtain a large-screen image matching the screen resolution include:
- the target picture is used as a large-screen picture matching the screen resolution
- the absolute value of the horizontal resolution difference is not equal to 0, take the absolute value of the horizontal resolution difference as the number of pixels to be filled in the horizontal direction of the target picture; determine the color to be filled, and obtain the The color pixel value corresponding to the color to be filled is filled; the target picture is filled with the color pixel value, and a large-screen image matching the screen resolution is obtained.
- the category to which the screen resolution belongs is high-definition resolution, creating a floating window layer on the large-screen image, and configuring and filling the floating window layer on the floating window layer through a preset algorithm
- the translation expansion area and the direct viewing area corresponding to the category to which the screen resolution belongs including:
- a preset direct vision algorithm is added to obtain the first direct vision area; wherein, the first translation expansion area includes the first direct vision area;
- the category to which the screen resolution belongs is ultra-high-definition resolution
- creating a floating window layer placed on the large-screen image and configuring and filling the floating window layer on the floating window layer through a preset algorithm
- the translation expansion area and the direct viewing area corresponding to the category to which the screen resolution belongs including:
- a preset direct vision algorithm is added to obtain a second direct vision area; wherein, the second translation expansion area includes the second direct vision area;
- An intelligent terminal wherein the intelligent terminal includes a large-screen display screen, a memory, a processor, and a program for creating panoramic pictures based on a large-screen that is stored in the memory and can run on the processor, and the processing
- the steps in the method for creating a panoramic picture based on a large screen as described in any one of the above are implemented when the device executes the program for creating a panoramic picture based on a large screen.
- a computer-readable storage medium wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, any one of the above-mentioned methods for creating a panoramic picture based on a large screen is implemented. step.
- the present application provides a method, device, intelligent terminal and medium for creating a panoramic picture based on a large screen.
- the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.
- FIG. 1 is a flowchart of a method for creating a panoramic image based on a large screen. It should be noted that the method for creating a panoramic picture based on a large screen according to the embodiment of the present invention is not limited to the steps and sequence in the flowchart shown in FIG. 1 , and the steps in the flowchart can be added, removed or Change the order. As shown in Figure 1, the method for creating a panoramic image based on a large screen includes:
- the system obtains the picture resolution of the target picture and the screen resolution of the large screen.
- the target picture refers to an object that needs to be synthesized into a panorama.
- the target picture is a standard-definition picture, that is, the picture resolution of the target picture is a standard-definition resolution, and the standard-definition resolution is usually 480p (720 ⁇ 480 pixel resolution, etc.) or 576p. Definition) means standard definition resolution.
- 480 in 480p refers to the vertical resolution, and there are 480 horizontal scan lines in the vertical direction.
- the target picture can come from the Internet or from shooting. Therefore, in order to improve the quality of the synthesized panorama, the target image can be preprocessed.
- the preprocessing operation refers to processing rules set according to user requirements, such as performing brightness enhancement processing on the target image, or performing cropping processing on the target image.
- the processing rules are not limited, and can be freely set according to different scenarios.
- Large screen refers to the display screen whose diagonal size is larger than 40 feet.
- the screen resolution of the large screen can be high-definition resolution HD (High Definition), 720p (1280 ⁇ 720 pixel resolution); can be full HD resolution FHD (Full High Definition), 1080p (1080 ⁇ 720 pixel resolution); can be UHD (Ultra High Definition), 4k (4096 ⁇ 2160 pixel resolution); can also be full ultra-high definition resolution FUHD (Full Ultra High Definition), 8k (7680 ⁇ 4320 pixel resolution, 16:9).
- the image resolution of the target image and the screen resolution of the large screen obtained by the system include:
- the system when monitoring the command of the intelligent terminal to send the target picture, the system receives the target picture and obtains the picture resolution of the target picture; the picture resolution is expressed as the number of horizontal pixels * the number of vertical pixels of the target picture;
- the system obtains the screen resolution of the large screen; the screen resolution is expressed as the number of horizontal pixels of the large screen * the number of vertical pixels.
- the screen resolution of the large screen is 1080p (1920*1080)
- 1920 represents the number of horizontal pixels
- 1080 represents the number of vertical pixels
- the image resolution of the target image is 720*640, where 720 represents is the number of horizontal pixels, and 640 is the number of vertical pixels.
- the system calculates the resolution difference between the picture resolution and the screen resolution, adjusts the target picture according to the resolution difference, and obtains a large-screen picture matching the screen resolution.
- both the picture resolution and the screen resolution include the number of horizontal pixels and the value of vertical pixels
- calculating the resolution difference between the picture resolution and the screen resolution is expressed as calculating the number of horizontal pixels and the screen resolution in the picture resolution.
- the resolution ratio is adjusted by calculating the difference between the number of horizontal pixels in the picture resolution and the number of horizontal pixels in the screen resolution as the resolution ratio.
- the difference between the number of horizontal pixels in the picture resolution and the number of horizontal pixels in the screen resolution is calculated to obtain the difference in horizontal resolution. Since the screen resolution is greater than or equal to the picture resolution, obtain the absolute value of the horizontal resolution difference.
- the target image is taken as a large-screen image matching the screen resolution. That is to say, the picture resolution of the target picture is the same as the screen resolution of the large screen, so there is no need to perform a filling operation on the target picture.
- the absolute value of the horizontal resolution difference is used as the number of pixels to be filled in the horizontal direction of the target picture.
- the target picture Pic_X(x1) 640//640 horizontal pixels in the horizontal direction;
- Horizontal resolution difference Dis_ChaRu(x1)
- 440 is the horizontal resolution difference
- 440 is used as the horizontal direction of the target picture. The number of padding pixels.
- the filling process it is necessary to pre-determine the color to be filled, and after obtaining the color pixel value of the color to be filled, use the color pixel value to fill the target image, so that the image resolution of the large-screen image obtained after filling the target image is the same as The screen resolution of the large screen is the same and matched.
- the system determines the color to be filled, and obtains the color pixel value corresponding to the color to be filled as follows:
- the color pixel value of each filling color includes R value, G value and B value;
- S213 Determine the color corresponding to the R mean value, the G mean value and the B mean value, the color is the color to be filled, and the color pixel values of the color to be filled are the R mean value, the G mean value, and the B mean value.
- the color pixel values of the fill color on the target image all include RGB values. Therefore, the average pixel filter is used to filter out the color with the most colors in red, green and blue on the target image, and this color is used as the pending color. Fill color, whose color pixel value is the average value of each RGB.
- Ave_PixelRGB(r1,g1,b1) ⁇ "0","128",”255" ⁇ //The average value is the pixels filled with blue.
- the target image is filled, and the filling is stopped when the number of filled pixels reaches the number of pixels to be filled, such as 440, and a large-screen image corresponding to the stop filling is obtained at this time.
- the image resolution of the large-screen image obtained after filling is the same as the screen resolution.
- the system creates a floating window layer placed on the large-screen image, and configures and fills the translation expansion area and the direct viewing area corresponding to the category to which the screen resolution belongs on the floating window layer through a preset algorithm;
- the expansion area is used to convert the target image into a large-screen image through panning and expansion operations;
- the direct-view area is used to convert the large-screen image into a panoramic image through parallax.
- the system respectively sets the layer transparency of the floating window layer corresponding to the translation expansion area and the direct viewing area.
- the categories to which the screen resolutions belong are divided into two categories: high-definition resolutions and ultra-high-definition resolutions. Therefore, for these two categories, the corresponding translation expansion area and direct vision area are created respectively.
- the translation expansion area can be regarded as projecting the target image to the large screen for seamless connection.
- the direct viewing area of interest can be regarded as the parallax formed after the target image is projected.
- Expansion area and direct vision area including:
- the system sets the layer transparency of the floating window layer corresponding to the panning extension area and the direct viewing area respectively, including:
- the screen resolution is 1080p
- the picture resolution of the target picture is 720*640
- intercept 540 pixels on each horizontal line obtain the length of the pixels intercepted on each horizontal line
- configure the first translation expansion area FOV resolution specifically, the length of the first translation expansion area is 540.
- the first translation expansion area is filled by intercepting 540 pixels on each horizontal line of the target image through the translation expansion algorithm, and the layer transparency from left to right of the floating window layer corresponding to the first translation expansion area is configured to be translucent, that is, 50%. .
- S323 calculate the high-definition picture corresponding to the high-definition resolution of the target picture; wherein, the picture resolution of the high-definition picture is greater than the picture resolution of the target picture;
- Setting the layer transparency of the floating window layer corresponding to the panning extension area and the direct viewing area respectively includes:
- the target image needs to be converted into a high-definition image, and then the high-definition image is converted into an ultra-high-definition image, that is, a large-screen image.
- the high-definition image corresponding to the high-definition resolution of the target image is calculated; the image resolution of the high-definition image is greater than the image resolution of the target image. That is, the high-definition picture can be the large-screen picture in (1) above.
- intercept 1440 pixels on each horizontal line and obtain the length of the pixels intercepted on each horizontal line.
- Configure the second translation Expanded regional FOV resolution specifically, the length of the second translation expansion area is 1440.
- Intercept 1440 pixels on each horizontal line on the high-definition picture through the translation expansion algorithm to fill the second translation expansion area, and configure the layer transparency of the floating window layer corresponding to the second translation expansion area from left to right to be translucent, that is, 50%. .
- the system synthesizes the floating window layers with different layer transparency and the large screen to obtain a panorama of the target image.
- a panorama image with different resolutions of the target picture is obtained by synthesizing the floating window layer with different layer transparency and the large screen.
- the category of screen resolution is high-definition resolution, using seamless overlay technology, the floating window layer with different layer transparency is synthesized with the large screen, and the high-definition panorama of the target image is obtained;
- the category of screen resolution is ultra-high-definition Using the seamless overlay technology, the floating window layer with different layer transparency is synthesized with the large screen to obtain an ultra-high-definition panorama of the target image.
- the present application uses the resolution difference to generate a large-screen image (that is, a plane panorama) that matches the screen resolution of the target image, and then expands the area through different layer transparency and translation of the floating window layer.
- a large-screen image that is, a plane panorama
- Algorithms and direct vision algorithms and seamless overlay technology transform the large-screen image into a three-dimensional panorama, thus combining the smart large-screen with VR technology, enabling the smart large-screen to provide a 360° panorama, improving user vision.
- the present application further provides an apparatus for creating a panoramic picture based on a large screen.
- FIG. 2 illustrates a schematic structural diagram of an apparatus for creating a panoramic picture based on a large screen in the present application.
- the device may include an acquisition module 100, a resolution adjustment module 200, a translation expansion area module 300, a direct view module 400, and a panorama synthesis module 500.
- FIG. 2 only shows some components of the device, but it should be understood that Implementation of all illustrated components is not required, and more or fewer components may be implemented instead.
- the device can be any device that can be connected to the Internet, such as a mobile phone, an ipad, and a desktop computer.
- an acquisition module 100 used for acquiring the picture resolution of the target picture and the screen resolution of the large screen
- the resolution adjustment module 200 is used to calculate the resolution difference between the picture resolution and the screen resolution, and adjust the target picture according to the resolution difference to obtain a large-screen image matching the screen resolution;
- the translation expansion area module 300 is used to create a floating window layer placed on the large-screen image, and configure and fill the translation expansion area corresponding to the category to which the screen resolution belongs on the floating window layer through a preset algorithm, and set the translation expansion area.
- the direct vision module 400 is used for configuring and filling the direct viewing area through the direct viewing algorithm according to the translation expansion area module, and setting the layer transparency of the floating window layer corresponding to the direct viewing area; wherein , the direct viewing area is used to convert the large-screen image into a panoramic image through parallax;
- the panorama synthesis module 500 is used for synthesizing the floating window layer with different layer transparency and the large screen to obtain the panorama of the target picture, and is specifically as described above for the method for creating a panorama picture based on the large screen.
- the present application also provides an intelligent terminal.
- the intelligent terminal 1 may be any network-enabled device such as a mobile phone, an ipad, and a desktop computer.
- the intelligent terminal 1 includes a processor 20 and a memory 22 connected to the processor 20.
- FIG. 3 only shows some components of the intelligent terminal 1, but it should be understood that it is not required to implement all the shown components, and alternative implementations are possible. more or fewer components.
- the memory 22 may be an internal storage unit of the smart terminal 1 in some embodiments, such as a memory of the smart terminal 1 .
- the memory 22 may also be an external storage device of the smart terminal 1, such as a plug-in U disk equipped on the smart terminal 1, a smart memory card (Smart Media Card, SMC), Secure Digital (SD) card, Flash Card (Flash Card), etc.
- the memory 22 may also include both an internal storage unit of the smart terminal 1 and an external storage device.
- the memory 22 is used to store application software installed in the smart terminal 1 and various data, such as display program codes of web pages, and the like.
- the memory 22 may also be used to temporarily store data that has been or will be output.
- the memory 22 stores a webpage display program, and the webpage display program can be executed by the processor 20 as follows:
- the acquisition module is used to acquire the image resolution of the target image and the screen resolution of the large screen
- the resolution adjustment module is used to calculate the resolution difference between the image resolution and the screen resolution, and adjust the target image according to the resolution difference to obtain a large-screen image that matches the screen resolution;
- the translation expansion area module is used to create a floating window layer on the large screen image, and configure and fill the translation expansion area corresponding to the category of the screen resolution on the floating window layer through a preset algorithm, and set the translation expansion The layer transparency of the floating window layer corresponding to the area and the direct viewing area; wherein, the translation expansion area is used to convert the target image into a large-screen image through translation and expansion operations;
- the direct vision module is used for configuring and filling the direct viewing area through the direct viewing algorithm according to the translation expansion area module, and setting the layer transparency of the floating window layer corresponding to the direct viewing area; wherein, The direct view area is used to convert large-screen images into panoramic images through parallax;
- the panorama synthesis module is used for synthesizing the floating window layer with different layer transparency and the large screen to obtain the panorama image of the target image, and the specific method is as described above.
- the processor 20 may be a central processing unit (Central Processing Unit) in some embodiments.
- Central Processing Unit CPU
- microprocessor microprocessor
- mobile phone baseband processor or other data processing chips, for running the program code or processing data stored in the memory 22, for example, executing the method of creating a panoramic picture based on a large screen.
- the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by the processor 20, implements the steps in the method for creating a panoramic picture based on a large screen, specifically as the above method.
- the storage medium may be a memory, a magnetic disk, an optical disk, or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Image Processing (AREA)
- Digital Computer Display Output (AREA)
Abstract
Description
分辨率模块 | 平移拓展区域模块 | 感兴直视模块 | 总计像素 |
FOV resolution | ROI resolution | Total | |
FHD360 Video(1080) | 3/4*720 | 1/2 SD(640) | |
1080 | 540 | 320 | 860 |
4k 360 Video(3840) | 4/3* FHD(1080) | 3/4 HD(720) | |
3840 | 1440 | 540 | 1980 |
Claims (20)
- 一种基于大屏创建全景图片的方法,其中,包括:获取目标图片的图片分辨率和大屏的屏幕分辨率;计算所述图片分辨率和所述屏幕分辨率的分辨率差值,根据所述分辨率差值对所述目标图片进行调整,得到与所述屏幕分辨率匹配的大屏图;创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域以及感兴直视区域;其中,所述平移拓展区域用于将所述目标图片通过平移操作和拓展操作转化为所述大屏图;所述感兴直视区域用于将所述大屏图通过视差转化为全景图;分别设定所述平移拓展区域和所述感兴直视区域所对应的所述悬浮窗图层的图层透明度;将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的全景图。
- 根据权利要求1所述的方法,其中,所述获取目标图片的图片分辨率和大屏的屏幕分辨率,包括:当监测到智能终端发送目标图片的命令时,接收所述目标图片并获取所述目标图片的图片分辨率;所述图片分辨率表示为所述目标图片的水平像素数*垂直像素数;获取所述大屏的屏幕分辨率;所述屏幕分辨率表示为所述大屏的水平像素数*垂直像素数。
- 根据权利要求2所述的方法,其中,所述计算所述图片分辨率和所述屏幕分辨率的分辨率差值,包括:计算图片分辨率中水平像素数与屏幕分辨率中水平像素数的分辨率差值以及图片分辨率中垂直像素数与屏幕分辨率中垂直像素数的分辨率差值。
- 根据权利要求3所述的方法,其中,所述计算所述图片分辨率和所述屏幕分辨率的分辨率差值,根据所述分辨率差值对所述目标图片进行调整,得到与所述屏幕分辨率匹配的大屏图,包括:将所述图片分辨率中的水平像素数与所述屏幕分辨率中的水平像素数作差,得到水平分辨率差值;若所述水平分辨率差值的绝对值等于0,则将所述目标图片作为与所述屏幕分辨率匹配的大屏图。
- 根据权利要求4所述的方法,其中,所述计算所述图片分辨率和所述屏幕分辨率的分辨率差值,根据所述分辨率差值对所述目标图片进行调整,得到与所述屏幕分辨率匹配的大屏图,包括:若水平分辨率差值的绝对值不等于0,则将水平分辨率差值的绝对值作为目标图片的水平方向上待填充像素个数。
- 根据权利要求5所述的方法,其中,所述若所述水平分辨率差值的绝对值不等于0,则将所述水平分辨率差值的绝对值作为所述目标图片的水平方向上待填充像素个数,包括:确定待填充颜色,并获取所述待填充颜色对应的颜色像素值;通过所述颜色像素值对所述目标图片填充,得到与所述屏幕分辨率匹配的大屏图。
- 根据权利要求6所述的方法,其中,所述确定待填充颜色,并获取所述待填充颜色对应的颜色像素值,包括:获取所述目标图片上各填充色的颜色像素值及各填充色对应的像素个数;各填充色的颜色像素值均包括R值、G值以及B值;根据各填充色的第一颜色像素值及各填充色对应的像素个数分别计算R值、G值以及B值的平均值,得到R均值、G均值以及B均值;确定所述R均值、所述G均值以及所述B均值对应的颜色,所述颜色为待填充颜色,所述待填充颜色的颜色像素值为所述R均值、所述G均值以及所述B均值。
- 根据权利要求1所述的方法,其中,若所述屏幕分辨率所属类别为高清分辨率,所述创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域以及感兴直视区域,包括:根据所述屏幕分辨率创建悬浮窗图层,以使得所述悬浮窗图层的大小与所述大屏相匹配;将所述悬浮窗图层置于所述大屏图上端;通过预设的平移拓展区域算法根据所述目标图片在所述悬浮窗图层上配置第一平移拓展区域;从水平方向截取所述目标图片上第一水平比例的第一水平像素;将所述第一水平像素填充至所述第一平移拓展区域;填充完所述第一平移拓展区域后增加预设的感兴直视算法,得到第一感兴直视区域;其中,所述第一平移拓展区域包括第一感兴直视区域;截取所述目标图片中垂直方向上第一垂直比例的第一垂直像素;将所述第一垂直像素填充至所述第一感兴直视区域。
- 根据权利要求8所述的方法,其中,所述分别设定所述平移拓展区域和所述感兴直视区域所对应的所述悬浮窗图层的图层透明度,包括:配置所述第一平移拓展区域所对应的悬浮窗图层的图层透明度为半透明;配置所述第一感兴直视区域所对应的悬浮窗图层的图层透明度为全透明。
- 根据权利要求9所述的方法,其中,所述将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的全景图,包括:利用无缝叠加技术,将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的全高清景图。
- 根据权利要求1所述的方法,其中,若所述屏幕分辨率所属类别为超高清分辨率,所述创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域以及感兴直视区域,包括:根据所述屏幕分辨率创建悬浮窗图层,以使得所述悬浮窗图层的大小与所述大屏相匹配;将所述悬浮窗图层置于所述大屏图上端;计算所述目标图片的高清分辨率对应的高清图片;其中,所述高清图片的图片分辨率大于所述目标图片的图片分辨率;通过预设的平移拓展区域算法根据高清图片在所述悬浮窗图层上配置第二平移拓展区域;从水平方向截取所述高清图片上第二水平比例的第二水平像素;将所述第二水平像素填充至所述第二平移拓展区域;填充完所述第二平移拓展区域后增加预设的感兴直视算法,得到第二感兴直视区域;其中,所述第二平移拓展区域包括所述第二感兴直视区域;截取所述高清图片中垂直方向上第二垂直比例的第二垂直像素;将所述第二垂直像素填充至所述第二感兴直视区域。
- 根据权利要求11所述的方法,其中,所述分别设定所述平移拓展区域和所述感兴直视区域所对应的所述悬浮窗图层的图层透明度,包括:配置所述第二平移拓展区域所对应的悬浮窗图层的图层透明度为半透明;配置所述第二感兴直视区域所对应的悬浮窗图层的图层透明度为全透明。
- 根据权利要求12所述的方法,其中,所述将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的全景图,包括:利用无缝叠加技术,将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的超高清全景图。
- 一种基于大屏创建全景图片的装置,其中,包括:获取模块,用于获取目标图片的图片分辨率和大屏的屏幕分辨率;分辨率调整模块,用于计算所述图片分辨率和所述屏幕分辨率的分辨率差值,根据所述分辨率差值对所述目标图片进行调整,得到与所述屏幕分辨率匹配的大屏图;平移拓展区域模块,用于创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域,并设定所述平移拓展区域所对应的所述悬浮窗图层的图层透明度;其中,所述平移拓展区域用于将所述目标图片通过平移操作和拓展操作转化为所述大屏图;感兴直视模块,用于根据所述平移拓展区域模块通过感兴直视算法配置和填充感兴直视区域,并设定所述感兴直视区域所对应的所述悬浮窗图层的图层透明度;其中,所述感兴直视区域用于将所述大屏图通过视差转化为全景图;全景合成模块,用于将不同图层透明度的所述悬浮窗图层与所述大屏合成,得到所述目标图片的全景图。
- 根据权利要求14所述的基于大屏创建全景图片的装置,其中,所述获取目标图片的图片分辨率和大屏的屏幕分辨率,包括:当监测到智能终端发送目标图片的命令时,接收所述目标图片并获取所述目标图片的图片分辨率;所述图片分辨率表示为所述目标图片的水平像素数*垂直像素数;获取所述大屏的屏幕分辨率;所述屏幕分辨率表示为所述大屏的水平像素数*垂直像素数。
- 根据权利要求15所述的基于大屏创建全景图片的装置,其中,所述计算所述图片分辨率和所述屏幕分辨率的分辨率差值,根据所述分辨率差值对所述目标图片进行调整,得到与所述屏幕分辨率匹配的大屏图,包括:将所述图片分辨率中的水平像素数与所述屏幕分辨率中的水平像素数作差,得到水平分辨率差值;若所述水平分辨率差值的绝对值等于0,则将所述目标图片作为与所述屏幕分辨率匹配的大屏图;若所述水平分辨率差值的绝对值不等于0,则将所述水平分辨率差值的绝对值作为所述目标图片的水平方向上待填充像素个数;确定待填充颜色,并获取所述待填充颜色对应的颜色像素值;通过所述颜色像素值对所述目标图片填充,得到与所述屏幕分辨率匹配的大屏图。
- 根据权利要求14所述的基于大屏创建全景图片的装置,其中,若所述屏幕分辨率所属类别为高清分辨率,所述创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域以及感兴直视区域,包括:根据所述屏幕分辨率创建悬浮窗图层,以使得所述悬浮窗图层的大小与所述大屏相匹配;将所述悬浮窗图层置于所述大屏图上端;通过预设的平移拓展区域算法根据所述目标图片在所述悬浮窗图层上配置第一平移拓展区域;从水平方向截取所述目标图片上第一水平比例的第一水平像素;将所述第一水平像素填充至所述第一平移拓展区域;填充完所述第一平移拓展区域后增加预设的感兴直视算法,得到第一感兴直视区域;其中,所述第一平移拓展区域包括第一感兴直视区域;截取所述目标图片中垂直方向上第一垂直比例的第一垂直像素;将所述第一垂直像素填充至所述第一感兴直视区域。
- 根据权利要求14所述的基于大屏创建全景图片的装置,其中,若所述屏幕分辨率所属类别为超高清分辨率,所述创建置于所述大屏图上的悬浮窗图层,并在所述悬浮窗图层上通过预设算法配置和填充所述屏幕分辨率所属类别对应的平移拓展区域以及感兴直视区域,包括:根据所述屏幕分辨率创建悬浮窗图层,以使得所述悬浮窗图层的大小与所述大屏相匹配;将所述悬浮窗图层置于所述大屏图上端;计算所述目标图片的高清分辨率对应的高清图片;其中,所述高清图片的图片分辨率大于所述目标图片的图片分辨率;通过预设的平移拓展区域算法根据高清图片在所述悬浮窗图层上配置第二平移拓展区域;从水平方向截取所述高清图片上第二水平比例的第二水平像素;将所述第二水平像素填充至所述第二平移拓展区域;填充完所述第二平移拓展区域后增加预设的感兴直视算法,得到第二感兴直视区域;其中,所述第二平移拓展区域包括所述第二感兴直视区域;截取所述高清图片中垂直方向上第二垂直比例的第二垂直像素;将所述第二垂直像素填充至所述第二感兴直视区域。
- 一种智能终端,其中,所述智能终端包括大屏显示屏、存储器、处理器及存储在所述存储器中并可在所述处理器上运行的基于大屏创建全景图片的程序,所述处理器执行所述基于大屏创建全景图片的程序时实现如权利要求1至13中任一项所述的基于大屏创建全景图片的方法中的步骤。
- 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现权利要求1至13中任一项所述的基于大屏创建全景图片的方法中的步骤。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2023530651A JP2023550764A (ja) | 2020-11-18 | 2021-11-01 | 大型ディスプレイに基づいてパノラマ画像を作成する方法、装置、スマート端末及び媒体 |
GB2308579.8A GB2616188A (en) | 2020-11-18 | 2021-11-01 | Method and apparatus for creating panoramic picture on basis of large screen, and intelligent terminal and medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011291487.5A CN114518860B (zh) | 2020-11-18 | 2020-11-18 | 基于大屏创建全景图片的方法、装置、智能终端及介质 |
CN202011291487.5 | 2020-11-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022105584A1 true WO2022105584A1 (zh) | 2022-05-27 |
Family
ID=81594727
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/127958 WO2022105584A1 (zh) | 2020-11-18 | 2021-11-01 | 基于大屏创建全景图片的方法、装置、智能终端及介质 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP2023550764A (zh) |
CN (1) | CN114518860B (zh) |
GB (1) | GB2616188A (zh) |
WO (1) | WO2022105584A1 (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114995701B (zh) * | 2022-07-19 | 2024-04-02 | 荣耀终端有限公司 | 悬浮窗控制方法及相关装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050008254A1 (en) * | 2003-04-15 | 2005-01-13 | Makoto Ouchi | Image generation from plurality of images |
US20080074489A1 (en) * | 2006-09-27 | 2008-03-27 | Samsung Electronics Co., Ltd. | Apparatus, method, and medium for generating panoramic image |
CN104181884A (zh) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | 一种基于全景视图的智能家居控制装置及方法 |
CN105516311A (zh) * | 2015-12-09 | 2016-04-20 | 中国农业银行股份有限公司 | 一种电子地图全景图获取方法及*** |
CN106462944A (zh) * | 2016-05-30 | 2017-02-22 | 香港应用科技研究院有限公司 | 将多个高分辨率图像映射到一个低分辨率360度图像上生成无重影的高分辨全景图 |
CN108307219A (zh) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | 一种高清电视全景视频智能展示方法 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100800660B1 (ko) * | 2006-09-21 | 2008-02-01 | 삼성전자주식회사 | 파노라마 영상 촬영 장치 및 방법 |
CN109062531B (zh) * | 2018-08-15 | 2021-08-27 | 京东方科技集团股份有限公司 | 拼接屏以及拼接屏的显示方法和显示控制装置 |
CN110377257B (zh) * | 2019-07-17 | 2022-04-19 | Oppo广东移动通信有限公司 | 图层合成方法、装置、电子设备及存储介质 |
-
2020
- 2020-11-18 CN CN202011291487.5A patent/CN114518860B/zh active Active
-
2021
- 2021-11-01 JP JP2023530651A patent/JP2023550764A/ja active Pending
- 2021-11-01 WO PCT/CN2021/127958 patent/WO2022105584A1/zh active Application Filing
- 2021-11-01 GB GB2308579.8A patent/GB2616188A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050008254A1 (en) * | 2003-04-15 | 2005-01-13 | Makoto Ouchi | Image generation from plurality of images |
US20080074489A1 (en) * | 2006-09-27 | 2008-03-27 | Samsung Electronics Co., Ltd. | Apparatus, method, and medium for generating panoramic image |
CN104181884A (zh) * | 2014-08-11 | 2014-12-03 | 厦门立林科技有限公司 | 一种基于全景视图的智能家居控制装置及方法 |
CN105516311A (zh) * | 2015-12-09 | 2016-04-20 | 中国农业银行股份有限公司 | 一种电子地图全景图获取方法及*** |
CN106462944A (zh) * | 2016-05-30 | 2017-02-22 | 香港应用科技研究院有限公司 | 将多个高分辨率图像映射到一个低分辨率360度图像上生成无重影的高分辨全景图 |
CN108307219A (zh) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | 一种高清电视全景视频智能展示方法 |
Also Published As
Publication number | Publication date |
---|---|
CN114518860A (zh) | 2022-05-20 |
CN114518860B (zh) | 2023-08-01 |
GB202308579D0 (en) | 2023-07-26 |
JP2023550764A (ja) | 2023-12-05 |
GB2616188A (en) | 2023-08-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9619861B2 (en) | Apparatus and method for improving quality of enlarged image | |
US6259470B1 (en) | Image capture system having virtual camera | |
US20080253685A1 (en) | Image and video stitching and viewing method and system | |
JP2009124685A (ja) | 複数のビデオを結合してリアルタイムで表示する方法及びシステム | |
WO2015161561A1 (zh) | 一种终端基于多摄像头实现合照的方法及装置 | |
US20170061686A1 (en) | Stage view presentation method and system | |
US20070247518A1 (en) | System and method for video processing and display | |
KR20060079079A (ko) | 파노라마식 이미지에서의 데드 존을 최소화하는 카메라시스템 및 방법 | |
CN110691175B (zh) | 演播室中模拟摄像机运动跟踪的视频处理方法及装置 | |
CN108665415B (zh) | 基于深度学习的图像质量提升方法及其装置 | |
US10250802B2 (en) | Apparatus and method for processing wide viewing angle image | |
CN114630053B (zh) | 一种hdr图像显示方法及显示设备 | |
US20220182595A1 (en) | Optical flow based omnidirectional stereo video processing method | |
JP2014501086A (ja) | 立体画像取得システム及び方法 | |
US11783445B2 (en) | Image processing method, device and apparatus, image fitting method and device, display method and apparatus, and computer readable medium | |
CN111866523A (zh) | 全景视频合成方法、装置、电子设备和计算机存储介质 | |
CN201846426U (zh) | 基于摄像的多画面自动几何与边缘融合*** | |
US8019180B2 (en) | Constructing arbitrary-plane and multi-arbitrary-plane mosaic composite images from a multi-imager | |
TWI615808B (zh) | 全景即時影像處理方法 | |
WO2022105584A1 (zh) | 基于大屏创建全景图片的方法、装置、智能终端及介质 | |
CN114979689A (zh) | 多机位直播导播方法、设备以及介质 | |
CN112770095B (zh) | 全景投影方法、装置及电子设备 | |
US20080100697A1 (en) | Methods and systems for producing seamless composite images without requiring overlap of source images | |
WO2018087856A1 (ja) | 映像合成装置及び映像合成方法 | |
CN106681674A (zh) | 一种虚拟现实显示器的显示控制方法及*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21893732 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023530651 Country of ref document: JP |
|
ENP | Entry into the national phase |
Ref document number: 202308579 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20211101 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21893732 Country of ref document: EP Kind code of ref document: A1 |