CN114691068A - Information display method and device based on screen projection technology - Google Patents
Information display method and device based on screen projection technology Download PDFInfo
- Publication number
- CN114691068A CN114691068A CN202210295849.0A CN202210295849A CN114691068A CN 114691068 A CN114691068 A CN 114691068A CN 202210295849 A CN202210295849 A CN 202210295849A CN 114691068 A CN114691068 A CN 114691068A
- Authority
- CN
- China
- Prior art keywords
- terminal
- display
- screen projection
- image
- panoramic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000005516 engineering process Methods 0.000 title claims abstract description 50
- 230000008859 change Effects 0.000 claims abstract description 72
- 238000012545 processing Methods 0.000 claims abstract description 32
- 230000008569 process Effects 0.000 claims abstract description 15
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 238000005259 measurement Methods 0.000 claims description 10
- 230000010365 information processing Effects 0.000 claims description 7
- 230000003068 static effect Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 230000001960 triggered effect Effects 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 5
- 230000000694 effects Effects 0.000 abstract description 21
- 238000010586 diagram Methods 0.000 description 23
- 230000006870 function Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 8
- 230000000007 visual effect Effects 0.000 description 8
- 230000005484 gravity Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 206010048669 Terminal state Diseases 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C1/00—Measuring angles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/60—Rotation of whole images or parts thereof
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The information display method and device based on the screen projection technology, provided by the embodiment of the application, in the screen projection display process of the terminal, the user can change the pose of the terminal through first operation, so that the terminal can perform panoramic display processing on a panoramic image through the pose change information of the terminal, the user can view the processed panoramic display image on the screen projection interface of the terminal, the interaction between the user and the image on the screen projection interface is realized, the image display means is enriched, the display effect and interestingness of the image are improved, and the user experience is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of electronics, in particular to an information display method and device based on a screen projection technology.
Background
With the rapid development of electronic technology, people can use a screen projection technology to project the display content of a terminal on a large-size display device so as to improve the visual effect of the display content.
In the process of screen projection display of screen projection information to be projected by an existing terminal, in order to improve the utilization rate of a screen projection interface of the terminal, image information is often displayed on the screen projection interface of the terminal.
However, the existing image information has a single display form, a poor display effect and poor user experience.
Disclosure of Invention
The information display method and device based on the screen projection technology can enrich the display modes of the image information of the screen projection interface of the terminal, and improve the display effect and the user experience.
In a first aspect, an embodiment of the present application provides an information display method based on a screen projection technology, where in a process of performing screen projection display on a terminal, the information display method includes:
responding to a first operation of a user, and acquiring pose change information of a terminal;
and carrying out panoramic display processing on the preset panoramic image according to the pose change information, and displaying the processed panoramic display image at a first preset display position of a screen projection interface of the terminal.
It can know is, through at the in-process that throws the screen display and shows, the terminal utilizes position appearance change information to carry out panorama display to panoramic picture and handles to show the panoramic picture that obtains and display the position at the first display position of predetermineeing of throwing the screen interface, thereby can promote the terminal to throw the bandwagon effect of the image on the screen interface, and then promote user experience.
Optionally, the obtaining pose change information of the terminal includes:
acquiring measurement parameters of a gyroscope of a terminal; and determining pose change information according to the measurement parameters.
The gyroscope is called to acquire the pose change information of the terminal, so that the pose change of the terminal is accurately measured, and the interaction between the terminal and a user is conveniently realized.
Optionally, the pose change information includes pitch angle change information and azimuth angle change information of the terminal.
Optionally, the panoramic display processing is performed on the preset panoramic image according to the pose change information, and the method includes:
calling a panoramic image playing component; and inputting the panoramic image and the pose change information into a panoramic image playing component to obtain a panoramic display image.
It can be known that, the panorama display to panoramic picture handles the accessible and calls panoramic picture play subassembly and realizes, can effectively promote panoramic picture's display efficiency through such mode, brings better visual experience for the user.
Optionally, the panoramic display processing is performed on the preset panoramic image according to the pose change information, and the method includes:
carrying out space mapping processing on the panoramic image so as to map the panoramic image onto a cubic model to obtain cubic six-face images; taking the center of a cubic model where cubic six-face images are located as a viewpoint of a terminal, and taking the viewpoint as a rotation origin to perform rotation processing based on pose change information on a view plane of the terminal; and determining an image of the cubic six-face image projected on the rotated view plane, wherein the image is a panoramic display image.
Optionally, the panoramic image is a spherical panoramic image.
It is known that by using a panoramic image display technique based on cubic six-sided images, panoramic display of a panoramic image based on changes in terminal pose can be realized, giving the user an image immersion feeling.
Optionally, the method further includes:
responding to a second operation triggered by the user to the terminal, establishing a screen projection channel and loading the panoramic image; displaying a preset static image at a first preset display position of a screen projection interface until the loading of the panoramic image is finished; and displaying the panoramic image at a first preset display position of the screen projection interface by using a panoramic display technology of the panoramic image.
It can be known that, because the loading and the show to panoramic picture need certain time, in order to avoid throwing the problem that blank image appears in the first preset display position department on the screen interface, this embodiment will show at first preset display position and have static image before the terminal shows panoramic picture to promote user experience.
Optionally, the method further includes:
and displaying the screen projection information of the terminal at a second preset display position of the screen projection interface.
Optionally, the method further includes:
and updating the screen projection information according to the screen projection state of the terminal.
It can know that screen projection information is displayed at a second preset display position of the screen projection interface of the terminal, and the screen projection information can be used for representing the screen projection state of the terminal so that a user can know the current screen projection state of the terminal quickly.
In a second aspect, an embodiment of the present application provides an information processing apparatus based on a screen projection technology, where the information processing apparatus is installed in a terminal; the information processing apparatus includes:
the interaction module is used for responding to a first operation of a user in the screen projection display process of the terminal and acquiring pose change information of the terminal;
and the display module is used for carrying out panoramic display processing on the preset panoramic image according to the pose change information and displaying the processed panoramic display image at a first preset display position of a screen projection interface of the terminal.
Optionally, the interaction module is specifically configured to: acquiring measurement parameters of a gyroscope of a terminal; and determining pose change information according to the measurement parameters.
Optionally, the pose change information includes pitch angle change information and azimuth angle change information of the terminal.
Optionally, the display module is specifically configured to: calling a panoramic image playing component; and inputting the panoramic image and the pose change information into a panoramic image playing component to obtain a panoramic display image.
Optionally, the display module is specifically configured to: carrying out space mapping processing on the panoramic image so as to map the panoramic image onto a cubic model to obtain cubic six-face images; taking the center of a cubic model where cubic six-face images are located as a viewpoint of a terminal, and taking the viewpoint as a rotation origin to perform rotation processing based on pose change information on a view plane of the terminal; and determining an image of the cubic six-face image projected on the rotated view plane, wherein the image is a panoramic display image.
Optionally, the panoramic image is a spherical panoramic image.
Optionally, the method further includes: a communication module;
the communication module is used for establishing a screen projection channel and loading the panoramic image when the interaction module responds to a second operation triggered by the user to the terminal;
the display module is further used for displaying a preset static image at a first preset display position of the screen projection interface until the communication module finishes loading the panoramic image; the display module is further used for displaying the panoramic image at a first preset display position of the screen projection interface by utilizing a panoramic display technology of the panoramic image.
Optionally, the display module is further configured to display the screen projection information of the terminal at a second preset display position on the screen projection interface.
Optionally, the display module is further configured to update the screen projection information according to the screen projection state of the terminal.
In a third aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor; at least one processor; and
a memory;
the memory stores computer-executable instructions;
the at least one processor executes computer-executable instructions stored by the memory to cause the at least one processor to perform a method as in the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, in which computer-executable instructions are stored, and when the processor executes the computer-executable instructions, the method according to the first aspect is implemented.
In a fifth aspect, embodiments of the present application provide a computer program product comprising a computer program that, when executed by a processor, performs the method according to the first aspect.
The information display method and device based on the screen projection technology, provided by the embodiment of the application, in the screen projection display process of the terminal, the user can change the pose of the terminal through first operation, so that the terminal can perform panoramic display processing on a panoramic image through the pose change information of the terminal, the user can view the processed panoramic display image on the screen projection interface of the terminal, the interaction between the user and the image on the screen projection interface is realized, the image display means is enriched, the display effect and interestingness of the image are improved, and the user experience is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is an information display flow based on a screen projection technology in a conventional entertainment scene;
FIG. 2 is a schematic diagram of a network architecture on which the present application is based;
fig. 3 is a schematic flowchart of an information display method based on a screen projection technology according to an embodiment of the present application;
fig. 4 is a schematic processing diagram of information display based on screen projection technology provided in the present application;
fig. 5 is a schematic view illustrating a first display effect of information display based on a screen projection technology provided in the present application;
fig. 6 is a schematic view illustrating a second display effect of information display based on a screen projection technology provided in the present application;
fig. 7 is a schematic diagram illustrating a third display effect of information display based on a screen projection technology provided in the present application;
fig. 8 is a schematic diagram illustrating a first interface change of information display based on a screen projection technology according to the present application;
fig. 9 is a schematic diagram illustrating a second interface change of information display based on a screen projection technology according to the present application;
fig. 10 is a schematic structural diagram of an information display device based on a screen projection technology according to an embodiment of the present application;
fig. 11 is a schematic diagram of a hardware structure of an electronic device provided in the present application.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In the technical scheme of the application, the processing of collecting, storing, using, processing, transmitting, providing, disclosing and the like of various related information accords with the regulations of related laws and regulations, and does not violate the common customs of public sequences.
With the rapid development of electronic technology, people can use a screen projection technology to project the display content of a terminal on a large-size display device so as to improve the visual effect of the display content.
The screen projection technology can be applied to various scenes, such as entertainment scenes, meeting scenes, education scenes and the like.
Under the entertainment scene, a user can trigger the screen projection function of the entertainment APP of the mobile phone terminal so as to realize screen projection display of screen projection content to be projected in the entertainment APP. The entertainment APP comprises but is not limited to a video APP, a live APP, a game APP and the like.
Fig. 1 is an information display process based on a screen projection technology in an existing entertainment scene, and as shown in the left diagram of fig. 1, a user can click a "video APP" icon on a terminal display interface to start a video APP. And the terminal display interface is switched to the APP interface of the video APP.
As shown in the middle diagram of fig. 1, when a user watches a video by using a video APP, the user can perform screen projection display on the screen projectable content in the video playing area by triggering a "screen projection click" function.
As shown in the right diagram of fig. 1, after the user triggers the screen projection function, the terminal can implement screen projection display of the screen projectable content through the screen projection connection channel between the terminal and the screen projection device. The projection device includes, but is not limited to, a projector, a display device, and the like.
Of course, in other scenarios (e.g., meeting scenarios, educational scenarios, etc.), the user may implement the screen-shot display of the screen-shot content using similar operations.
In any scene, in the screen projection process of the terminal, a screen projection state prompt of '… in screen projection connection' is displayed on a screen projection interface of the terminal so as to prompt a user of the current terminal state. In addition, "image information" is also generally displayed on the terminal screen projection interface, and the information content of the "image information" can be generally determined by the APP service provider. However, the image information is generally displayed on the screen projection interface in a static display manner, and such image information has a single display form, a poor display effect, and poor user experience.
In order to solve the problems, the application provides an information display method and device based on a screen projection technology, so that the possibility of interaction with an image on a terminal screen projection interface is provided for a user, image display means are enriched, the image display effect and interestingness are improved, and the user experience is improved.
Fig. 2 is a schematic diagram of a network architecture based on the present application, and the network architecture shown in fig. 2 may specifically include a terminal 1, a screen projection device 2, and a routing device 3.
The terminal 1 may specifically be a hardware device having a network communication function, a screen projection function, a display function, and a touch function, and includes but is not limited to a smart phone, a tablet computer, a desktop computer, an internet of things device, and the like, as shown in fig. 2, in this scenario, the terminal 1 is specifically a smart phone.
The screen projection device 2 may be a hardware device having a network communication function and a screen projection function, and includes, but is not limited to, a projector device, an intelligent screen projection terminal, a large-size display, and the like. As shown in fig. 2, the projection device 2 in this scenario is specifically a projector.
The terminal 1 and the screen projection equipment 2 can realize the screen projection function based on Wi-Fi wireless screen projection. In the scenario shown in fig. 2, the terminal 1 and the screen projection device 2 may be connected to the wireless lan provided by the routing device 3 at the same time, so as to establish a screen projection connection channel and transmit screen projection data by using the wireless lan.
Certainly, in other scenarios, the terminal 1 and the screen projection device 2 may implement the screen projection function based on the WHDI wireless screen projection technology or the millimeter wave wireless screen projection technology, and the application does not excessively describe the scene diagrams of the two technologies.
It should be noted that the information display method based on the screen projection technology provided in the embodiments of the present application can be applied to any one of the above-mentioned screen projection technical solutions.
The information display method and device based on the screen projection technology provided by the present application are described in detail below by specific embodiments. The following embodiments may be combined with each other and may not be described in detail in some embodiments for the same or similar concepts or processes.
It should be noted that the main execution body of the information display method based on the screen projection technology provided in this embodiment is the aforementioned terminal, and fig. 3 is a flowchart of the information display method based on the screen projection technology provided in this embodiment of the present application. As shown in fig. 3, the information display method based on the screen projection technology is triggered in the process of screen projection display by the terminal, and the method may include the following steps:
It should be noted that the information display method provided by the present application is executed in a state where the terminal has completed the screen projection connection with the screen projection device or is attempting the screen projection connection with the screen projection device under the operation of the user, that is, the screen projection interface should be displayed on the display interface of the terminal at this time.
Specifically, the first operation may be an operation of rotating the terminal, which may be expressed as an operation of rotating the terminal with the rotation axis as an axis held by the user, wherein the direction of the rotation axis is not limited at all. For example, the axial direction of the rotating shaft may be perpendicular to the horizontal plane, or the axial direction of the rotating shaft may be parallel to the horizontal plane, or the axial direction of the rotating shaft may form an inclined angle with the horizontal plane, or the like.
Through the first operation of the user, the pose of the terminal is changed, and the pose change information of the terminal can be acquired at the moment. Exemplarily, the pose change information includes pitch angle change information and azimuth angle change information of the terminal, where the pitch angle change information refers to a rotation angle of the terminal along a rotation axis parallel to a horizontal plane; and the azimuth angle variation information refers to a rotation angle of the terminal along a rotation axis perpendicular to a horizontal plane.
The manner of acquiring the pose change information of the terminal can include various manners, and in an optional embodiment, the acquiring of the pose change information can be realized by a gyroscope, wherein the gyroscope is a sensor which is installed inside the terminal and can be used for detecting the pose of the terminal. When a user triggers a first operation to enable the pose of the terminal to change, the terminal monitors a gravity sensing event, at the moment, the terminal calls a gravity sensing interface to read measurement parameters of a gyroscope arranged in the terminal, and pose change information of the terminal is determined according to the measurement parameters.
In other optional embodiments, obtaining the pose change information can be further achieved through a terminal camera module, wherein the camera module is a modular component which is installed on the terminal and comprises a camera unit, a flash unit, a laser ranging unit and the like. When a user triggers a first operation to enable the pose of the terminal to change, the terminal monitors a gravity sensing event, and at the moment, the terminal can also call the camera module to acquire pose change information of the terminal by using a visual SLAM algorithm.
And 302, performing panoramic display processing on the preset panoramic image according to the pose change information, and displaying the processed panoramic display image at a first preset display position of a screen projection interface of the terminal.
Specifically, the panoramic image is a real 360-degree omnidirectional image that gives a three-dimensional stereoscopic feeling to a person. The panoramic image of a certain scene can be obtained by image splicing of images obtained by the scene at different shooting angles.
In an optional implementation manner of the present application, the terminal may directly call a panoramic image playing component pre-stored in the server to implement the panoramic display processing. Namely, the terminal can call the panoramic image playing component, and input the panoramic image and the obtained pose change information to the panoramic image playing component to obtain the panoramic display image.
By the mode, the panoramic image can be displayed quickly, the display efficiency is improved, and better visual experience is provided for users.
The panoramic image playing component can be realized based on multiple languages or multiple platforms, exemplarily, the panoramic image playing component can be realized by using Webview, and also can be realized by using WebGLRender, CSS3DRender or canvas reader, and the application does not limit the realization mode of the panoramic image playing component.
In yet another alternative embodiment, the terminal may further perform display processing on the panoramic image by using a panoramic display algorithm. Fig. 4 is a schematic processing diagram of information display based on a screen projection technology provided in the present application, and as shown in fig. 4, a terminal may perform spatial mapping processing on a panoramic image to map the panoramic image onto a cubic model, so as to obtain cubic six-sided images.
Subsequently, as shown in the left diagram of fig. 4, the terminal performs rotation processing based on the pose change information on the viewing plane 402 of the terminal with the viewpoint as the rotation origin and the cubic model center 401 where the six cubic images are located as the viewpoint of the terminal, so as to obtain the viewing plane 403 shown in the right diagram of fig. 4.
Finally, the terminal determines an image 404 of the cubic six-sided image projected on the rotated viewing plane 403, where the image 404 is a panoramic display image, that is, the image 404 is to be displayed at a first preset display position of the terminal screen projection interface.
In fig. 4, the panoramic image is a spherical panoramic image.
By the two modes, panoramic display of the panoramic image is realized. In order to further describe the information display method based on the screen projection technology provided by the present application, the display effect of the present application will be further described below with reference to an actual scene schematic diagram.
It is known that, when the user performs the first operation on the terminal, the display effect of the panorama display image will change accordingly based on the difference in the rotation direction of the first operation.
Fig. 5 is a schematic view of a first display effect of information display based on a screen projection technology provided in the present application, when a user rotates a terminal by using a y-axis as a rotation axis, a panoramic display image displayed at a first preset display position 501 of a screen projection interface of the terminal will have a corresponding rotation of a viewing angle, as shown in fig. 5, the panoramic display image after the rotation of the viewing angle presents a visual experience similar to that of viewing an image with a head tilted state to the user.
Fig. 6 is a schematic view of a second display effect of information display based on a screen projection technology provided in the present application, when a user rotates a terminal by using a y-axis as a rotation axis, a panoramic display image displayed at a first preset display position 601 of a screen projection interface of the terminal will rotate at a corresponding viewing angle, as shown in fig. 6, the panoramic display image after the viewing angle rotation presents a visual experience similar to that of viewing the image in a "top view" or "bottom view" manner to the user.
Fig. 7 is a schematic diagram of a third display effect of information display based on a screen projection technology provided in the present application, when a user rotates a terminal by using a z-axis as a rotation axis, a panoramic display image displayed at a first preset display position 701 of a screen projection interface of the terminal will rotate at a corresponding viewing angle, as shown in fig. 7, the panoramic display image after the viewing angle rotation presents a visual experience similar to that of viewing an image around the user.
On the basis of the above embodiments, because a certain time is required for loading and displaying the panoramic image, in order to avoid the problem that a blank image appears at the first preset display position of the screen projection interface, the application further includes the following scheme:
fig. 8 is a schematic diagram illustrating a change of a first interface of information display based on a screen projection technology, as shown in fig. 8, in which a terminal responds to a second operation triggered by a user to the terminal, establishes a screen projection channel, and loads the panoramic image. The second operation may specifically be an operation of starting screen projection by the user control terminal. In the process of loading the panoramic image, the terminal also displays a preset static image at a first preset display position 801 of a screen projection interface until the panoramic image is loaded; then, the panoramic image is displayed at a first preset display position 801 of the screen projection interface by using the panoramic display technology of the panoramic image.
Subsequently, the terminal may respond to the first operation initiated by the user to process the panoramic image for the panoramic display processing according to the aforementioned embodiments. Through the processing mode, the problem that a blank image can appear at the first preset display position of the screen projection interface before the loading of the panoramic image is completed can be effectively avoided, and the user experience is improved.
On the basis of the above embodiments, in order to facilitate the user to quickly know the current screen projection state of the terminal, screen projection information is also displayed on the screen projection interface of the terminal. In other words, in an alternative, the information display method further includes: and displaying the screen projection information of the terminal at a second preset display position 901 of the screen projection interface.
Fig. 9 is a second interface change schematic diagram of information display based on a screen projection technology provided by the present application, and as shown in the left diagram of fig. 9, a user prompt of "establishing connection" is displayed on screen projection information. And when the screen projection state changes, the screen projection information also changes correspondingly, namely the terminal updates the screen projection information according to the screen projection state. As shown in the right diagram of fig. 9, after the screen projection channel is established, the terminal starts to perform screen projection display on the screen projection content, and at this time, the screen projection information will display a user prompt of "in screen projection".
According to the information display method based on the screen projection technology, in the screen projection display process of the terminal, the user can change the pose of the terminal through first operation, so that the terminal can perform panoramic display processing on the panoramic image through the pose change information of the terminal, the user can view the processed panoramic display image on the screen projection interface of the terminal, interaction between the user and the image on the screen projection interface is achieved, image display means are enriched, the display effect and interestingness of the image are improved, and user experience is improved.
On the basis of the above embodiments, the execution subject of the information display method based on the screen projection technology provided in the present embodiment is the aforementioned terminal.
Fig. 10 is a schematic structural diagram of an information display device based on a screen projection technology according to an embodiment of the present application. As shown in fig. 10, the information processing apparatus includes:
the interaction module 1010 is used for responding to a first operation of a user in the process of screen projection display of the terminal and acquiring pose change information of the terminal;
and the display module 1020 is configured to perform panoramic display processing on the preset panoramic image according to the pose change information, and display the processed panoramic display image at a first preset display position of the terminal screen projection interface.
Optionally, the interaction module 1010 is specifically configured to: acquiring measurement parameters of a gyroscope of a terminal; and determining pose change information according to the measurement parameters.
Optionally, the pose change information includes pitch angle change information and azimuth angle change information of the terminal.
Optionally, the display module 1020 is specifically configured to: calling a panoramic image playing component; and inputting the panoramic image and the pose change information into a panoramic image playing component to obtain a panoramic display image.
Optionally, the display module 1020 is specifically configured to: carrying out space mapping processing on the panoramic image so as to map the panoramic image onto a cubic model to obtain cubic six-face images; taking the center of a cubic model where cubic six-face images are located as a viewpoint of a terminal, and taking the viewpoint as a rotation origin to perform rotation processing based on pose change information on a view plane of the terminal; and determining an image of the cubic six-face image projected on the rotated view plane, wherein the image is a panoramic display image.
Optionally, the panoramic image is a spherical panoramic image.
Optionally, the method further includes: a communication module;
the communication module is used for establishing a screen projection channel and loading the panoramic image when the interaction module 1010 responds to a second operation triggered by the user to the terminal;
the display module 1020 is further configured to display a preset static image at a first preset display position of the screen projection interface until the communication module finishes loading the panoramic image; the display module 1020 is further configured to display the panoramic image at a first preset display position of the screen projection interface by using a panoramic display technology of the panoramic image.
Optionally, the display module 1020 is further configured to display the screen projection information of the terminal at a second preset display position of the screen projection interface.
Optionally, the display module 1020 is further configured to update the screen projection information according to the screen projection state of the terminal.
The information display device based on screen projecting technology that this application embodiment provided, in-process that screen projecting display was carried out at the terminal, user's accessible first operation makes the position appearance at terminal change, thereby make the position appearance change information that the terminal can self carry out the panorama display processing to panoramic image, the user can watch the panoramic display image after handling on the screen projecting interface at terminal, thereby realize the user and throw the image on the screen interface and carry out the interaction, enrich the image display means, promote the bandwagon effect and the interest of image, promote user experience.
Fig. 11 is a schematic diagram of a hardware structure of an electronic device provided in the present application, and as shown in fig. 11, an embodiment of the present application provides an electronic device, a memory of the electronic device may be configured to store at least one program instruction, and a processor is configured to execute the at least one program instruction, so as to implement the technical solution of the foregoing method embodiment. The implementation principle and technical effect are similar to those of the embodiments related to the method, and are not described herein again.
The embodiment of the application provides a chip. The chip comprises a processor for calling a computer program in a memory to execute the technical solution in the above embodiments. The principle and technical effects are similar to those of the related embodiments, and are not described herein again.
The embodiment of the present application provides a computer program product, which, when the computer program product runs on an electronic device, enables the electronic device to execute the technical solutions in the above embodiments. The principle and technical effects are similar to those of the related embodiments, and are not described herein again.
The embodiment of the present application provides a computer-readable storage medium, on which program instructions are stored, and when the program instructions are executed by an electronic device, the electronic device is enabled to execute the technical solutions of the above embodiments. The implementation principle and technical effect are similar to those of the related embodiments, and are not described herein again.
The above embodiments are provided to explain the purpose, technical solutions and advantages of the present application in further detail, and it should be understood that the above embodiments are merely illustrative of the present application and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present application should be included in the scope of the present application.
Claims (13)
1. An information display method based on screen projection technology is characterized in that in the screen projection display process of a terminal, the information display method comprises the following steps:
responding to a first operation of a user, and acquiring pose change information of a terminal;
and carrying out panoramic display processing on a preset panoramic image according to the pose change information, and displaying the processed panoramic display image at a first preset display position of the terminal screen projection interface.
2. The information display method according to claim 1, wherein the acquiring of the pose change information of the terminal includes:
acquiring measurement parameters of a gyroscope of the terminal;
and determining the pose change information according to the measurement parameters.
3. The information display method according to claim 1, wherein the pose change information includes pitch angle change information and azimuth angle change information of the terminal.
4. The information display method according to claim 1, wherein the performing panoramic display processing on a preset panoramic image according to the pose change information includes:
calling a panoramic image playing component;
and inputting the panoramic image and the pose change information into the panoramic image playing component to obtain the panoramic display image.
5. The information display method according to claim 1, wherein the performing panoramic display processing on a preset panoramic image according to the pose change information includes:
carrying out space mapping processing on the panoramic image so as to map the panoramic image onto a cubic model to obtain cubic six-face images;
taking the center of a cubic model where the cubic six-face image is located as a viewpoint of a terminal, and performing rotation processing based on the pose change information on a view plane of the terminal by taking the viewpoint as a rotation origin;
and determining an image of the cubic six-face image projected on the rotated view plane, wherein the image is the panoramic display image.
6. The information display method according to claim 5, wherein the panoramic image is a spherical panoramic image.
7. The information display method according to claim 1, further comprising:
responding to a second operation triggered by the user to the terminal, establishing a screen projection channel and loading the panoramic image;
displaying a preset static image at a first preset display position of the screen projection interface until the panoramic image is loaded;
and displaying the panoramic image at a first preset display position of the screen projection interface by utilizing a panoramic display technology of the panoramic image.
8. The information display method according to any one of claims 1 to 7, further comprising:
and displaying the screen projection information of the terminal at a second preset display position of the screen projection interface.
9. The information display method according to claim 8, further comprising:
and updating the screen projection information according to the screen projection state of the terminal.
10. An information processing device based on screen projection technology is characterized in that the information processing device is installed in a terminal; the information processing apparatus includes:
the interaction module is used for responding to a first operation of a user in the screen projection display process of the terminal and acquiring pose change information of the terminal;
and the display module is used for carrying out panoramic display processing on a preset panoramic image according to the pose change information and displaying the processed panoramic display image at a first preset display position of the terminal screen projection interface.
11. An electronic device, comprising:
at least one processor; and
a memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the method of claims 1-9.
12. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, perform the method of claims 1-9.
13. A computer program product comprising computer instructions, characterized in that the computer instructions, when executed by a processor, implement the method according to claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295849.0A CN114691068A (en) | 2022-03-23 | 2022-03-23 | Information display method and device based on screen projection technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295849.0A CN114691068A (en) | 2022-03-23 | 2022-03-23 | Information display method and device based on screen projection technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114691068A true CN114691068A (en) | 2022-07-01 |
Family
ID=82138835
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210295849.0A Pending CN114691068A (en) | 2022-03-23 | 2022-03-23 | Information display method and device based on screen projection technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114691068A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117793239A (en) * | 2022-09-29 | 2024-03-29 | 荣耀终端有限公司 | Weather dynamic effect display method, computer storage medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017088491A1 (en) * | 2015-11-23 | 2017-06-01 | 乐视控股（北京）有限公司 | Video playing method and device |
| WO2017177622A1 (en) * | 2016-04-12 | 2017-10-19 | 乐视控股（北京）有限公司 | Method and apparatus for playing panoramic video, and electronic device |
| US20180249076A1 (en) * | 2017-02-27 | 2018-08-30 | Alibaba Group Holding Limited | Image Mapping and Processing Method, Apparatus and Machine-Readable Media |
| US20190057487A1 (en) * | 2017-08-16 | 2019-02-21 | Via Technologies, Inc. | Method and apparatus for generating three-dimensional panoramic video |
| US20190246162A1 (en) * | 2017-03-28 | 2019-08-08 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for presenting and controlling panoramic image, and storage medium |
| CN111966314A (en) * | 2020-08-11 | 2020-11-20 | 北京小米移动软件有限公司 | Image projection method, image projection device, mobile terminal and projection equipment |
-
2022
- 2022-03-23 CN CN202210295849.0A patent/CN114691068A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017088491A1 (en) * | 2015-11-23 | 2017-06-01 | 乐视控股（北京）有限公司 | Video playing method and device |
| WO2017177622A1 (en) * | 2016-04-12 | 2017-10-19 | 乐视控股（北京）有限公司 | Method and apparatus for playing panoramic video, and electronic device |
| US20180249076A1 (en) * | 2017-02-27 | 2018-08-30 | Alibaba Group Holding Limited | Image Mapping and Processing Method, Apparatus and Machine-Readable Media |
| US20190246162A1 (en) * | 2017-03-28 | 2019-08-08 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for presenting and controlling panoramic image, and storage medium |
| US20190057487A1 (en) * | 2017-08-16 | 2019-02-21 | Via Technologies, Inc. | Method and apparatus for generating three-dimensional panoramic video |
| CN111966314A (en) * | 2020-08-11 | 2020-11-20 | 北京小米移动软件有限公司 | Image projection method, image projection device, mobile terminal and projection equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117793239A (en) * | 2022-09-29 | 2024-03-29 | 荣耀终端有限公司 | Weather dynamic effect display method, computer storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106803966B (en) | Multi-user network live broadcast method and device and electronic equipment thereof | |
| WO2022088918A1 (en) | Virtual image display method and apparatus, electronic device and storage medium | |
| US20240214513A1 (en) | Method and apparatus for controlling a plurality of virtual characters, device, and storage medium | |
| CN108144294B (en) | Interactive operation implementation method and device and client equipment | |
| CN106791906B (en) | Multi-user network live broadcast method and device and electronic equipment thereof | |
| CN110213608B (en) | Method, device, equipment and readable storage medium for displaying virtual gift | |
| US11956547B2 (en) | Omnidirectional camera system with improved point of interest selection | |
| JP6298563B1 (en) | Program and method for providing virtual space by head mounted device, and information processing apparatus for executing the program | |
| CN110139116B (en) | Live broadcast room switching method and device and storage medium | |
| US20200380724A1 (en) | Personalized scene image processing method, apparatus and storage medium | |
| CN107295393B (en) | method and device for displaying additional media in media playing, computing equipment and computer-readable storage medium | |
| CN111603771A (en) | Animation generation method, device, equipment and medium | |
| JP2019179382A (en) | Information processing program, information processing method and information processing system | |
| CN112468884A (en) | Dynamic resource display method, device, terminal, server and storage medium | |
| JP2009251858A (en) | Image conversion program and image conversion device | |
| CN114691068A (en) | Information display method and device based on screen projection technology | |
| CN112261482B (en) | Interactive video playing method, device and equipment and readable storage medium | |
| CN112843695B (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN111242107B (en) | Method and electronic device for setting virtual object in space | |
| CN111672107B (en) | Virtual scene display method and device, computer equipment and storage medium | |
| JP2019012509A (en) | Program for providing virtual space with head-mounted display, method, and information processing apparatus for executing program | |
| CN112973116A (en) | Virtual scene picture display method and device, computer equipment and storage medium | |
| CN107506026A (en) | The method, apparatus and head-mounted display apparatus of control application operation | |
| CN113209610A (en) | Virtual scene picture display method and device, computer equipment and storage medium | |
| CN114826799A (en) | Information acquisition method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220701 |
|
| RJ01 | Rejection of invention patent application after publication |