CN112911257A - Projection type interaction method, system and storage medium - Google Patents
Projection type interaction method, system and storage medium Download PDFInfo
- Publication number
- CN112911257A CN112911257A CN202110094663.4A CN202110094663A CN112911257A CN 112911257 A CN112911257 A CN 112911257A CN 202110094663 A CN202110094663 A CN 202110094663A CN 112911257 A CN112911257 A CN 112911257A
- Authority
- CN
- China
- Prior art keywords
- image
- interactive
- display
- images
- infrared monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3155—Modulator illumination systems for controlling the light source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application relates to a projection type interaction method, a projection type interaction system and a storage medium, wherein the method comprises the following steps: acquiring an all-dimensional display image of a current exhibit, generating a plurality of primary reference images, setting pause display nodes in the all-dimensional display image and setting pause duration for the pause display nodes; acquiring a part display image; performing gridding processing on the primary reference image to generate a grid coordinate graph; generating an interactive reference table; if a projection request signal is received, sending the omnibearing display image to a preset image projection unit; after receiving the infrared monitoring request signal, sending the corresponding grid coordinate graph to a preset infrared projection device; after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to judge whether to perform interactive action or not; if the judgment result is that the interactive action is needed, generating an interactive response signal; and feeding back the interactive response signal to a preset image projection unit. This application has the effect that improves the bandwagon show effect of showpiece on the stand.
Description
Technical Field
The present application relates to the field of projection technologies, and in particular, to a projection-type interaction method, system, and storage medium.
Background
In the process of enterprise propaganda or product propaganda at present, exhibition in occasions such as large exhibitions is more and more emphasized by enterprises, the exhibition behavior is regarded as an important propaganda means, each enterprise hopes that the enterprise or the product thereof can stand out in a plurality of same enterprises or similar products, and the role of the exhibition stand is very important here. At present, exhibition stands in various exhibitions often adopt a mode introduced by a physical exhibition processing worker to display products.
With respect to the related art in the above, the inventors consider that: most exhibits are statically exhibited, so that visitors cannot emphatically know the exhibits according to interest points of the visitors, and the exhibiting effect of the exhibits is poor.
Disclosure of Invention
In order to improve the display effect of exhibits on a display stand, the application provides a projection type interaction method, a projection type interaction system and a storage medium.
In a first aspect, the present application provides a projection-type interaction method, which adopts the following technical scheme:
a projected interaction method, comprising:
acquiring an omnibearing display image of a current exhibit, and selecting a plurality of frames of images to generate a plurality of primary reference images;
setting pause display nodes in the omnibearing display image and setting pause duration for the omnibearing display image, wherein each pause display node corresponds to a primary reference image;
acquiring a plurality of part display images of the current exhibit;
respectively carrying out gridding processing on each primary reference image to generate a grid coordinate graph;
identifying and marking interactive grids in each grid coordinate graph, and generating an interactive reference table by combining the corresponding primary reference images;
if receiving a projection request signal, sending the omni-directional display image to a preset image projection unit so as to carry out the following operations: projecting the omnibearing display image for a visitor to observe; carrying out pause processing on each pause display node so that visitors can interact in a mode of emitting infrared interaction light spots, and simultaneously generating an infrared monitoring request signal at each pause display node;
after receiving the infrared monitoring request signal, sending the corresponding grid coordinate graph to a preset infrared projection device for projection, and simultaneously generating a monitoring start signal and sending the monitoring start signal to a preset infrared monitoring unit so as to generate and feed back a real-time infrared monitoring image;
after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to judge whether to perform interactive action;
if the interactive action is needed, generating an interactive response signal by combining the interactive reference table, wherein the interactive response signal carries a corresponding part display image;
and feeding back the interactive response signal to a preset image projection unit so as to enable the interactive response signal to project a corresponding part display image.
By adopting the technical scheme, after the server processes the acquired all-dimensional display image and the acquired part display image, the server utilizes the preset image projection device to perform projection display on the all-dimensional display image, so that a visitor can know the exhibit more intuitively; meanwhile, visitors can interact with the projection according to the interest points of the visitors, so that the preset image projection device projects the part display images which the visitors want to know, and the display effect of the exhibits on the exhibition stand is improved.
Optionally, after the obtaining of the plurality of part display images of the current exhibit, the method further includes:
displaying images for each part, selecting a plurality of frame images from the images and storing the frame images as secondary reference images, wherein each secondary reference image corresponds to a primary reference image, and the external observation angles of the primary reference image and the secondary reference image which correspond to each other are the same;
acquiring a plurality of transition images, wherein the head frame image and the tail frame image of each transition image are a primary reference image and a secondary reference image which correspond to each other in sequence;
the primary reference image, the secondary reference image and the transition image are stored in an associated mode to generate a reference relation table;
if the interactive action is judged to be needed, generating an interactive response signal by combining the interactive reference table, which specifically comprises the following steps: and if the interactive action is judged to be needed, generating an interactive response signal by combining the interactive reference table and the reference relation table.
Through adopting above-mentioned technical scheme, insert the transition image between all-round show image and part show image, and the head and the tail frame image of transition image is corresponding one-level reference image and secondary reference image each other in proper order for projected interactive process is more level and smooth, makes each main part and the whole structural relation between the showpiece more clear simultaneously, has further improved the bandwagon effect to the showpiece.
Optionally, the identifying and marking the interactive grids in each grid coordinate graph and generating an interactive reference table by combining the corresponding primary reference image specifically include:
performing coincidence comparison on each primary reference image and the grid coordinate graph corresponding to the primary reference image, sequentially identifying image blocks corresponding to each main component in the first reference image, and marking the grids with the coincidence proportion of the image blocks larger than a threshold value as interactive grids;
distributing identification marks to each interactive grid, so that all the interactive grids corresponding to the image blocks corresponding to the same main component have the same identification marks;
and establishing a corresponding relation between the identification mark and the part display image corresponding to the picture block to generate an interactive reference table.
By adopting the technical scheme, after the infrared monitoring image is received, the interactive reference table is helpful for the server to identify the infrared monitoring image, thereby being helpful for realizing the interactive function.
Optionally, after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to determine whether to perform an interactive action, specifically including:
identifying the received real-time infrared monitoring image, and if an infrared interaction light spot exists in the real-time infrared monitoring image, calculating the coordinate of the infrared interaction light spot;
and if the real-time infrared monitoring images at a plurality of continuous moments are identified to contain infrared interaction light spots which are all in interaction grids with the same identification marks, judging that interaction action is required.
By adopting the technical scheme, the server can identify the interaction request of the visitor, so that the interaction function can be realized, and meanwhile, the possibility of misjudgment is reduced by identifying the infrared interaction light spots at a plurality of continuous moments.
Optionally, the projection-type interaction method further includes the following steps:
according to the preset updating node, the following processing is carried out: and updating the pause duration of each pause display node by using a preset judgment method at each update node.
By adopting the technical scheme, the server can update the pause duration of each pause display node according to the interest degree of the visitor to different main components of the exhibit, so that the display effect and the user experience of the visitor are improved.
In a second aspect, the present application provides a server, which adopts the following technical solutions:
a server, comprising:
a receiving module: the system comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving a projection request signal and an infrared monitoring request signal;
an image acquisition module: the system is used for acquiring an all-dimensional display image and a component display image;
a storage module: the all-dimensional display image and the component display image acquired by the image acquisition module are stored; the processing module is used for processing the various items of content generated by the processing module;
a processing module: for performing the following processes:
processing the omnidirectional display image acquired by the image acquisition module to generate a plurality of primary reference images; setting pause display nodes in the omnibearing display images and setting pause duration for the pause display nodes; performing gridding processing on the primary reference image to generate a grid coordinate graph; after receiving the infrared monitoring request signal, generating a monitoring start signal; after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to judge whether to perform interactive action; generating an interactive response signal;
a sending module: the omnidirectional display image is sent after the projection request signal is received; the grid coordinate graph and the monitoring starting signal are sent after the infrared monitoring request signal is received; for transmitting the interactive response signal
By adopting the technical scheme, the display effect of the exhibits on the exhibition stand can be improved.
In a third aspect, the present application provides a projection-type interactive system, which adopts the following technical solutions:
a projected interactive system, comprising: an image projection unit, an infrared light spot generation unit, an infrared monitoring unit, and the server according to the second aspect.
Through adopting above-mentioned technical scheme, realized improving the bandwagon show effect of showpiece on the stand.
In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions:
a computer readable storage medium storing a computer program that can be loaded by a processor and execute the method according to the first aspect.
By adopting the above technical solution, when the computer-readable storage medium is loaded into any computer, the computer can execute the projected interaction method provided by the first aspect.
In summary, the present application includes at least one of the following beneficial technical effects:
1. by projecting the correlated omnibearing display image and the component display image, the visitor can interact with the projection, so that the display effect of the exhibits on the exhibition stand is improved;
2. through the periodic updating of the pause duration of each pause display node, the display time of each pause display node is more suitable for interest points and requirements of visitors, and therefore the display effect of the exhibits on the exhibition stand is further improved.
Drawings
Fig. 1 is a block diagram of a projection-type interactive system according to an embodiment of the present disclosure.
Fig. 2 is a flowchart of a projective interaction method according to an embodiment of the present application.
Fig. 3 is a schematic diagram for embodying a grid coordinate graph in the embodiment of the present application.
Fig. 4 is a block diagram of a server according to an embodiment of the present application.
Description of reference numerals: 1. a projected interactive system; 2. an image projection unit; 3. an infrared projection unit; 4. an infrared light spot generating unit; 5. an infrared monitoring unit; 6. a server; 61. a receiving module; 62. an image acquisition module; 63. a storage module; 64. a processing module; 65. and a sending module.
Detailed Description
The present application is described in further detail below with reference to figures 1-4.
The embodiment of the application discloses projection formula interactive system, referring to fig. 1, a projection formula interactive system includes:
the image projection unit 2 comprises a main image projection device and a plurality of auxiliary image projection devices, wherein the main image projection device is used for projecting the omnibearing display image to a preset main projection area, and carrying out pause processing on the omnibearing display image at each pause display node; meanwhile, when entering each pause display node, sending an infrared monitoring request signal to the server 6;
the auxiliary image projection device is used for receiving the projection interaction signal and projecting a corresponding image to an auxiliary projection area according to the received projection interaction response signal;
an infrared projection unit 3, including an infrared projection device corresponding to the main image projection device, for projecting the grid coordinate graph to a preset main projection area in the form of infrared rays, so that the grid coordinate graph can be identified by the infrared monitoring unit 5;
the infrared light spot generating unit 4 comprises an infrared ray generating device and is used for generating an infrared interaction light spot which can be identified by the infrared monitoring unit 5 according to the requirements of visitors and irradiating the infrared interaction light spot to a preset main projection area;
the infrared monitoring unit 5 comprises an infrared monitoring device and is used for monitoring the main projection area, identifying the grid coordinate graph projected by the infrared projection unit 3 and the infrared interaction light spot generated by the infrared light spot generation unit 4; the system is used for acquiring real-time infrared monitoring images according to a preset frequency and feeding the acquired infrared monitoring images back to the server 6;
and a server 6.
Based on the projection type interactive system, the embodiment of the application discloses a projection type interactive method. Referring to fig. 2, a projected interaction method includes the following steps:
s100: and acquiring an all-dimensional display image of the current exhibit.
Specifically, the omni-directional display image can be acquired in an instant scanning mode or a direct recording mode. The omnibearing displayed image can be an actual demonstration image of the current exhibit or a simulated animation demonstration image.
S101: a primary reference image is generated.
Specifically, a plurality of frame images in the omnibearing display image are selected according to the distribution condition of main components of the current exhibit, and the images are stored as primary reference images. The main components are components needing to be displayed emphatically, and at least one main component is clearly displayed in each primary reference image. And numbering the primary reference images according to the appearance sequence of the primary reference images in the omnibearing display image, so that each primary reference image corresponds to a unique primary code.
S102: and setting a pause display node in the omnibearing display image.
Specifically, pause display nodes are set in the omnibearing display image, and pause duration is set for each pause display node; wherein each pause presentation node corresponds to a primary reference picture.
S110: the acquisition component displays an image.
Specifically, for each main part of the current exhibit, a part display image corresponding to the main part is acquired. The component display image is a structure display image of the corresponding main part, and can be acquired in a real-time scanning mode or a direct input mode. S110 and S100 are performed simultaneously.
S111: a secondary reference image is generated.
Specifically, the following processing is performed for each part display image:
selecting a plurality of frame images, and storing the frame images as secondary reference images; interrupt nodes are provided, each interrupt node corresponding to a secondary reference picture.
It should be noted that each of the secondary reference images corresponds to one of the primary reference images, and the primary reference image and the secondary reference image corresponding to each other have the same external viewing angle.
S120: and acquiring a transition image.
The transitional images can be obtained in an instant scanning mode or a direct recording mode, the head frame image and the tail frame image of each transitional image are the primary reference image and the secondary reference image which correspond to each other in sequence, and the external observation angles of the primary reference image and the secondary reference image which correspond to each other are the same. S120 and S110 are performed simultaneously.
S200: and generating a reference relation table.
Specifically, the primary reference image generated in S101, the secondary reference image generated in S111, and the transition video acquired in S120 are stored in association with each other to generate the reference relationship table. Wherein, the reference relation table records a one-to-one correspondence relation among the primary reference image, the secondary reference image and the transitional image.
S300: and carrying out gridding processing on the primary reference image.
Specifically, the primary reference image is a square image, and with reference to fig. 3, each primary reference image is processed as follows: taking the intersection point of the lower left corner of the primary reference image as an origin point, and taking two sidelines corresponding to the intersection point as coordinate axes to generate a two-dimensional rectangular coordinate system; meanwhile, a grid with a proper size is selected, so that a picture block corresponding to any main part in the primary reference image at least completely covers one grid area. And generating a grid coordinate graph corresponding to the first reference image according to the grid size and the two-dimensional rectangular coordinate system, and associating the grid coordinate graph with the primary code corresponding to the first reference image.
S310: and respectively identifying the grid coordinate graphs and generating an interactive reference table.
And (3) carrying out superposition comparison on each primary reference image and the grid coordinate graph corresponding to the primary reference image in combination with the graph shown in the figure 3. Specifically, the two images are completely overlapped, the image block corresponding to each main component in the first reference image is sequentially identified, in fig. 3, the dotted line portion represents the image block corresponding to the main component, and the grid having an overlap ratio with the image block larger than a threshold value is marked as an interactive grid, where the overlap ratio is a ratio between an area of an overlapped region in a single grid and a total area of the single grid, and the threshold value may be, for example, 60%, 70%, or the like.
And allocating an identification mark to each interactive grid, wherein all interactive grids corresponding to the image blocks corresponding to the same main component have the same identification mark. And establishing a corresponding relation between the identification mark and the part display image corresponding to the picture block to generate an interactive reference table. For example, for a rectangular primary reference image, taking the corner point at the lower left corner of the primary reference image as the origin, the coordinates of the corner point being (0, 0), and taking two edge lines corresponding to the corner point as the X axis and the Y axis, respectively; the length of each grid in the X-axis direction is m, and the length of each grid in the Y-axis direction is n, and then the method for allocating the identification identifier to each interactive grid is as follows: and identifying coordinates of grid points at the upper right corner of each interactive grid, and assuming that the grid points at the upper right corner of an interactive grid correspond to coordinates (a, b, n), identifying the interactive grid as [ a, b ].
S400: and sending the omnibearing display image to a main image projection device for projection.
Specifically, the omni-directional display image corresponding to the current exhibit is sent to the main image projection device, so that the following processing is performed:
playing an all-dimensional display image and projecting the all-dimensional display image to a main projection area; carrying out pause processing on the omnibearing displayed image at each pause display node, so that a visitor has enough time to observe main components in the omnibearing displayed image and selects to carry out interactive operation;
meanwhile, when entering each pause display node, sending an infrared monitoring request signal to the server 6, wherein the infrared monitoring request signal carries a primary code of a primary reference image corresponding to the current pause display node;
after receiving the infrared monitoring request signal, the process simultaneously proceeds to S410 and S420.
S410: and sending the grid coordinate graph to an infrared projection device.
Specifically, a primary code in the received infrared monitoring request signal is identified, a grid coordinate graph corresponding to the primary code is extracted according to the primary code, and the grid coordinate graph is sent to the infrared projection device for the infrared projection device to perform the following processing: and projecting the grid coordinate graph to the main projection area in the form of infrared rays, wherein the boundary of the grid coordinate graph is completely coincided with the boundary of the current primary reference image.
S420: a monitoring start signal is generated and sent to the infrared monitoring unit 5.
Specifically, a monitoring start signal is generated and sent to the infrared monitoring unit 5, so that the infrared monitoring unit 5 performs the following processing:
monitoring the main projection area and acquiring a real-time infrared monitoring image according to a preset frequency, wherein the preset frequency can be 10 times/s, 20 times/s and the like; and feeding back the acquired real-time infrared monitoring image to the server 6. The real-time infrared monitoring image comprises a grid coordinate graph corresponding to the current primary reference image, and the grid coordinate graph is displayed in an infrared mode.
S500: and receiving the real-time infrared monitoring image and identifying the real-time infrared monitoring image.
Specifically, identifying a received real-time infrared monitoring image, and if an infrared interaction light spot exists in the real-time infrared monitoring image, calculating the coordinate of the infrared interaction light spot according to a current grid coordinate graph;
if the real-time infrared monitoring images at a plurality of continuous moments are identified to contain infrared interaction light spots, and the infrared interaction light spots are all positioned in interaction grids with the same identification marks, judging that interaction action is required, and entering S510 at the moment;
s510: and generating an interactive response signal according to the interactive reference table and the reference relation table.
Specifically, extracting an interactive reference table, and calling a corresponding part display image according to the identification mark identified in the step S500; calling a corresponding primary reference image according to a primary code in the received infrared monitoring request signal, and calling a corresponding secondary reference image and a transition image according to a reference relation table generated in S130; determining a corresponding interrupt node according to the secondary reference image;
generating an interactive response signal, wherein the interactive response signal carries the following information corresponding to each other: recording a component display image, a primary reference image, a transition image and a secondary reference image of an interrupt node;
and storing the interactive response signal and the primary code in an associated manner.
And S520, sending the interactive response signal to the secondary image projection device.
Specifically, the interactive response signal is sent to a secondary image projection device in an idle state so as to perform the following processing:
firstly, projecting a primary reference image carried in an interactive response signal so as to attract the attention of a visitor; and then, projecting the transition image and the secondary reference image carried in the interactive response signal in sequence, and after projecting the secondary reference image, starting to project the component display image carried in the interactive response signal from the corresponding interrupt node.
In general, visitors have different degrees of interest in different main components of the exhibit, so that the visitors can conveniently improve the display effect, and the embodiment further includes the following steps:
s600: at each update node, the pause duration is updated.
Specifically, at each preset update node, the following processing is performed: extracting all interactive response signals generated before the update node, counting the occurrence times of all primary codes corresponding to the interactive response signals, and sequencing all the primary codes according to the total occurrence number, wherein the primary codes correspond to the primary reference images one by one, so that the heat ranking of each primary reference image can be obtained; and updating the pause duration of each pause display node according to the sequencing result, so that the primary reference image with high heat obtains longer display time. Wherein, the specific time of the update node is preset by the staff and stored in the server 6, and the time interval between two adjacent update nodes is the same.
Based on the foregoing method, an embodiment of the present application further discloses a server, and with reference to fig. 4, the server 6 includes:
and the receiving module 61 is configured to receive the projection request signal, the infrared monitoring request signal sent by the image projection unit 2, and the infrared monitoring image sent by the infrared monitoring unit 5.
And an image obtaining module 62, configured to obtain the omni-directional display image, the component display image, and the interactive image.
A storage module 63, configured to store the omnidirectional display image, the component display image, and the interactive image acquired by the image acquisition module 62; for storing various judgment methods and processing methods that can be called by the processing module 64; and for storing items of content generated by processing module 64.
A processing module 64, configured to perform the following processing:
processing the omnidirectional display image acquired by the image acquisition module 62 to generate a primary reference image; numbering the primary reference images according to the appearance sequence of the primary reference images in the omnibearing display images; setting pause display nodes in the omnibearing display image, and setting pause duration for each pause display node;
processing the part presentation imagery acquired by the image acquisition module 62 to generate a secondary reference image;
generating a reference relation table;
performing gridding processing on the primary reference image to generate a grid coordinate graph, and associating the grid coordinate graph corresponding to each other with the primary code of the first reference image; carrying out coincidence comparison on each primary reference image and the corresponding grid coordinate graph to generate an interactive reference table;
generating a monitoring request signal;
and processing the interactive response signal and updating the pause duration at each updating node.
A sending module 65, configured to send the omnidirectional display image to the main image projection apparatus for projection; the system comprises an infrared projection device, a grid coordinate graph generating device and a grid coordinate graph generating device, wherein the grid coordinate graph generating device is used for generating a grid coordinate graph; for sending the monitoring start signal generated by the processing module 64 to the infrared monitoring unit 5; for sending the interactive response signal generated by the processing module 64 to the secondary image projecting device.
The embodiment of the present application further discloses a computer-readable storage medium, which stores a computer program that can be loaded by a processor and execute the projected interactive method as described above, and the computer-readable storage medium includes, for example: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above examples are only used to illustrate the technical solutions of the present application, and do not limit the scope of protection of the application. It is to be understood that the embodiments described are only some of the embodiments of the present application and not all of them. All other embodiments, which can be derived by a person skilled in the art from these embodiments without making any inventive step, are within the scope of the present application.
Claims (8)
1. A projected interaction method, comprising:
acquiring an omnibearing display image of a current exhibit, and selecting a plurality of frames of images to generate a plurality of primary reference images;
setting pause display nodes in the omnibearing display image and setting pause duration for the omnibearing display image, wherein each pause display node corresponds to a primary reference image;
acquiring a plurality of part display images of the current exhibit;
respectively carrying out gridding processing on each primary reference image to generate a grid coordinate graph;
identifying and marking interactive grids in each grid coordinate graph, and generating an interactive reference table by combining the corresponding primary reference images;
if receiving a projection request signal, sending the omni-directional display image to a preset image projection unit (2) so as to carry out the following operations: projecting the omnibearing display image for a visitor to observe; carrying out pause processing on each pause display node so that visitors can interact in a mode of emitting infrared interaction light spots, and simultaneously generating an infrared monitoring request signal at each pause display node;
after receiving the infrared monitoring request signal, sending the corresponding grid coordinate graph to a preset infrared projection device for projection, and simultaneously generating a monitoring start signal and sending the monitoring start signal to a preset infrared monitoring unit (5) so as to generate and feed back a real-time infrared monitoring image;
after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to judge whether to perform interactive action;
if the interactive action is needed, generating an interactive response signal by combining the interactive reference table, wherein the interactive response signal carries a corresponding part display image;
and feeding back the interactive response signal to a preset image projection unit (2) so as to project a corresponding part display image.
2. The projective interaction method of claim 1, wherein: after obtaining a plurality of part show images of current showpiece, still include:
displaying images for each part, selecting a plurality of frame images from the images and storing the frame images as secondary reference images, wherein each secondary reference image corresponds to a primary reference image, and the external observation angles of the primary reference image and the secondary reference image which correspond to each other are the same;
acquiring a plurality of transition images, wherein the head frame image and the tail frame image of each transition image are a primary reference image and a secondary reference image which correspond to each other in sequence;
the primary reference image, the secondary reference image and the transition image are stored in an associated mode to generate a reference relation table;
if the interactive action is judged to be needed, generating an interactive response signal by combining the interactive reference table, which specifically comprises the following steps: and if the interactive action is judged to be needed, generating an interactive response signal by combining the interactive reference table and the reference relation table.
3. The projective interaction method of claim 1, wherein: the identifying and marking of the interactive grids in each grid coordinate graph and the generation of the interactive reference table by combining the corresponding primary reference images specifically comprise:
performing coincidence comparison on each primary reference image and the grid coordinate graph corresponding to the primary reference image, sequentially identifying image blocks corresponding to each main component in the first reference image, and marking the grids with the coincidence proportion of the image blocks larger than a threshold value as interactive grids;
distributing identification marks to each interactive grid, so that all the interactive grids corresponding to the image blocks corresponding to the same main component have the same identification marks;
and establishing a corresponding relation between the identification mark and the part display image corresponding to the picture block to generate an interactive reference table.
4. The projected interaction method of claim 3, wherein after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to determine whether to perform an interaction specifically comprises:
identifying the received real-time infrared monitoring image, and if an infrared interaction light spot exists in the real-time infrared monitoring image, calculating the coordinate of the infrared interaction light spot;
and if the real-time infrared monitoring images at a plurality of continuous moments are identified to contain infrared interaction light spots which are all in interaction grids with the same identification marks, judging that interaction action is required.
5. The projective interaction method of claim 1, further comprising the steps of:
according to the preset updating node, the following processing is carried out: and updating the pause duration of each pause display node at each update node.
6. A server, comprising:
receiving module (61): the system comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving a projection request signal and an infrared monitoring request signal;
image acquisition module (62): the system is used for acquiring an all-dimensional display image and a component display image;
storage module (63): for storing the omnidirectional display image and the component display image acquired by an image acquisition module (62); for storing items of content generated by the processing module (64);
a processing module (64): for performing the following processes:
processing the omnidirectional display images acquired by the image acquisition module (62) to generate a plurality of primary reference images; setting pause display nodes in the omnibearing display images and setting pause duration for the pause display nodes; performing gridding processing on the primary reference image to generate a grid coordinate graph; after receiving the infrared monitoring request signal, generating a monitoring start signal; after receiving the real-time infrared monitoring image, identifying the real-time infrared monitoring image to judge whether to perform interactive action; generating an interactive response signal;
a transmission module (65): the omnidirectional display image is sent after the projection request signal is received; the grid coordinate graph and the monitoring starting signal are sent after the infrared monitoring request signal is received; for transmitting the interactive response signal.
7. A projected interactive system, comprising: -an image projection unit (2), -an infrared projection unit (3), -an infrared light spot generation unit (4), -an infrared monitoring unit (5), and-a server (6) according to claim 6.
8. A computer-readable storage medium characterized by: a computer program which can be loaded by a processor and which executes the method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110094663.4A CN112911257B (en) | 2021-01-25 | 2021-01-25 | Projection type interaction method, server, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110094663.4A CN112911257B (en) | 2021-01-25 | 2021-01-25 | Projection type interaction method, server, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112911257A true CN112911257A (en) | 2021-06-04 |
| CN112911257B CN112911257B (en) | 2021-12-31 |
Family
ID=76117306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110094663.4A Active CN112911257B (en) | 2021-01-25 | 2021-01-25 | Projection type interaction method, server, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112911257B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070273845A1 (en) * | 2006-05-26 | 2007-11-29 | Tom Birmingham | System and method for multi-directional positioning of projected images |
| CN101877180A (en) * | 2009-11-18 | 2010-11-03 | 北京同方瑞博数字技术有限公司 | Multi-media electronic reciprocal teaching system |
| US20110205147A1 (en) * | 2010-02-22 | 2011-08-25 | Microsoft Corporation | Interacting With An Omni-Directionally Projected Display |
| CN104104929A (en) * | 2014-02-11 | 2014-10-15 | 中兴通讯股份有限公司 | Remote projection method, device and system |
| US20150268773A1 (en) * | 2014-03-21 | 2015-09-24 | Dell Products L.P. | Projected Information Handling System Input Interface with Dynamic Adjustment |
| CN104977785A (en) * | 2014-04-09 | 2015-10-14 | 全视科技有限公司 | Combined visible and non-visible projection system |
| CN105046732A (en) * | 2015-07-21 | 2015-11-11 | 佛山科学技术学院 | Virtual imaging dynamic demonstration system |
| CN106485779A (en) * | 2016-03-22 | 2017-03-08 | 智合新天（北京）传媒广告股份有限公司 | A kind of 3D virtual interacting display platform and the method for showing 3D animation |
| CN106851235A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | The interaction display method and device of desk lamp |
| CN107423008A (en) * | 2017-03-10 | 2017-12-01 | 北京市中视典数字科技有限公司 | A kind of multi-cam picture fusion method and scene display device in real time |
| CN207397662U (en) * | 2017-08-28 | 2018-05-22 | 国网上海市电力公司 | It is a kind of can interactive experience exhibition centre structure |
| CN108989774A (en) * | 2017-06-05 | 2018-12-11 | 北京互动文博科技有限公司 | A kind of image interactive display systems and method |
-
2021
- 2021-01-25 CN CN202110094663.4A patent/CN112911257B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070273845A1 (en) * | 2006-05-26 | 2007-11-29 | Tom Birmingham | System and method for multi-directional positioning of projected images |
| CN101877180A (en) * | 2009-11-18 | 2010-11-03 | 北京同方瑞博数字技术有限公司 | Multi-media electronic reciprocal teaching system |
| US20110205147A1 (en) * | 2010-02-22 | 2011-08-25 | Microsoft Corporation | Interacting With An Omni-Directionally Projected Display |
| CN104104929A (en) * | 2014-02-11 | 2014-10-15 | 中兴通讯股份有限公司 | Remote projection method, device and system |
| US20150268773A1 (en) * | 2014-03-21 | 2015-09-24 | Dell Products L.P. | Projected Information Handling System Input Interface with Dynamic Adjustment |
| CN104977785A (en) * | 2014-04-09 | 2015-10-14 | 全视科技有限公司 | Combined visible and non-visible projection system |
| CN105046732A (en) * | 2015-07-21 | 2015-11-11 | 佛山科学技术学院 | Virtual imaging dynamic demonstration system |
| CN106485779A (en) * | 2016-03-22 | 2017-03-08 | 智合新天（北京）传媒广告股份有限公司 | A kind of 3D virtual interacting display platform and the method for showing 3D animation |
| CN106851235A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | The interaction display method and device of desk lamp |
| CN107423008A (en) * | 2017-03-10 | 2017-12-01 | 北京市中视典数字科技有限公司 | A kind of multi-cam picture fusion method and scene display device in real time |
| CN108989774A (en) * | 2017-06-05 | 2018-12-11 | 北京互动文博科技有限公司 | A kind of image interactive display systems and method |
| CN207397662U (en) * | 2017-08-28 | 2018-05-22 | 国网上海市电力公司 | It is a kind of can interactive experience exhibition centre structure |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112911257B (en) | 2021-12-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6798094B2 (en) | Methods and devices for marking and displaying space sizes in virtual 3D house models | |
| US10223605B2 (en) | Interactive virtual aquarium simulation system and associated methods | |
| US11605204B2 (en) | Image processing for augmented reality | |
| US20110128283A1 (en) | File selection system and method | |
| CN107168534B (en) | Rendering optimization method and projection method based on CAVE system | |
| US9424689B2 (en) | System,method,apparatus and computer readable non-transitory storage medium storing information processing program for providing an augmented reality technique | |
| CN113196785B (en) | Live video interaction method, device, equipment and storage medium | |
| KR20110010106A (en) | System and method for defining an activation area within a representation scenery of a viewer interface | |
| US20130198006A1 (en) | Providing targeted content for multiple users | |
| JP2016197342A (en) | Augmented reality program, augmented reality providing method, augmented reality providing device, and information delivery method | |
| CN103037186A (en) | Projector control device and projector control method | |
| CN114225400A (en) | Bullet screen processing method and device, storage medium and electronic equipment | |
| CN111182338A (en) | Video processing method and device, storage medium and electronic equipment | |
| CN113408484A (en) | Picture display method, device, terminal and storage medium | |
| CN112911257B (en) | Projection type interaction method, server, system and storage medium | |
| KR20180088005A (en) | authoring tool for generating VR video and apparatus for generating VR video | |
| KR20210118037A (en) | A method and apparatus for providing an advertising contents with an object on 3d contents | |
| Andreev et al. | Stereoscopic construction of textual information in presentations of research results on an autostereoscopic monitor | |
| CN111258408B (en) | Object boundary determining method and device for man-machine interaction | |
| CN110392310B (en) | Display method of video identification information and related equipment | |
| JP2018010431A (en) | Image processing device, image processing method, and program | |
| CN114357202A (en) | Tutorial data display method and device, computer equipment and storage medium | |
| CN113888257A (en) | Article-based display method, device and program product | |
| CN109753219B (en) | Handicraft production system, method and device based on virtual reality | |
| CN102075689A (en) | Character generator for rapidly making animation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |