CN114610217A - Method and device for displaying view and head-mounted display device - Google Patents

Method and device for displaying view and head-mounted display device Download PDF

Info

Publication number
CN114610217A
CN114610217A CN202210296801.1A CN202210296801A CN114610217A CN 114610217 A CN114610217 A CN 114610217A CN 202210296801 A CN202210296801 A CN 202210296801A CN 114610217 A CN114610217 A CN 114610217A
Authority
CN
China
Prior art keywords
view
scrolling
target interface
mask
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210296801.1A
Other languages
Chinese (zh)
Inventor
王永伟
刘昕笛
王璐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shining Reality Wuxi Technology Co Ltd
Original Assignee
Shining Reality Wuxi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shining Reality Wuxi Technology Co Ltd filed Critical Shining Reality Wuxi Technology Co Ltd
Priority to CN202210296801.1A priority Critical patent/CN114610217A/en
Publication of CN114610217A publication Critical patent/CN114610217A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the disclosure discloses a method and a device for displaying a view and a head-mounted display device, wherein the method comprises the following steps: in response to receiving the view scrolling instruction, determining a view scrolling direction and a scrolling distance in a target interface displayed by the head-mounted display device; controlling a first view to scroll with a first mask corresponding to the first view based on the view scrolling direction and the scrolling distance; releasing the scrolling processing resources of the first view in response to the first view scrolling away from the view display area of the target interface. The embodiment of the disclosure can improve the three-dimensional stereoscopic vision of vision and reduce the probability of system blockage.

Description

Method and device for displaying view and head-mounted display device
Technical Field
The present disclosure relates to the field of artificial intelligence technologies, and in particular, to a method and an apparatus for displaying a view, and a head-mounted display device.
Background
In scenes such as Virtual Reality (VR), Augmented Reality (AR), or Mixed Reality (MR), the terminal provides interactive immersive experience for the user by constructing a Virtual environment.
When the user uses the head-mounted display device, the interactive interface can be displayed through the scroll view to enhance the interface display effect. How to ensure the interface display effect when using the scroll view is an urgent problem to be solved.
Disclosure of Invention
The present disclosure is proposed to solve the above technical problems. Embodiments of the present disclosure provide a method, an apparatus, and a head-mounted display device for displaying a view.
According to a first aspect of embodiments of the present disclosure, there is provided a method for displaying a view, comprising:
in response to receiving the view scrolling instruction, determining a view scrolling direction and a scrolling distance in a target interface displayed by the head-mounted display device;
controlling the first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance, wherein the target interface comprises at least one first view, the first mask blocks partial area of the first view, the size of the first mask is smaller than that of the first view, and the scrolling speed of the first mask is larger than that of the first view;
responsive to the first view scrolling away from the view display area of the target interface, the scroll processing resources of the first view are released.
According to a second aspect of embodiments of the present disclosure, there is provided an apparatus for displaying a view, comprising:
the scroll information determining module is used for responding to the received view scrolling instruction and determining the scroll direction and the scroll distance of the view in the target interface displayed by the head-mounted display equipment;
the scroll control module is used for controlling the first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance, wherein the target interface comprises at least one first view, the first mask covers a partial area of the first view, the size of the first mask is smaller than that of the first view, and the scrolling speed of the first mask is greater than that of the first view;
and the scroll processing resource releasing module is used for responding to the scroll of the first view away from the view display area of the target interface and releasing the scroll processing resource of the first view.
According to a third aspect of embodiments of the present disclosure, a head mounted display device comprises the apparatus for displaying a view of the second aspect.
According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing processor-executable instructions;
a processor for reading executable instructions from the memory and executing the instructions to implement the method for displaying a view of the first aspect described above.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the method for displaying a view of the first aspect described above.
The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing in more detail embodiments of the present disclosure with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. In the drawings, like reference numbers generally represent like parts or steps.
FIG. 1 is an exemplary system architecture diagram of an embodiment of a method or apparatus for displaying views that may be applied to the present disclosure;
FIG. 2 is a schematic flow chart diagram of a method for displaying views in one embodiment of the present disclosure;
FIG. 3 is a schematic view of a target interface at a first time in one example of the present disclosure;
fig. 4 is a side view schematic diagram of a wearable device in use at a first time in one example of the present disclosure;
fig. 5 is a side view schematic diagram of a wearable device in use at a second moment in one example of the present disclosure;
fig. 6 is a schematic side view of a wearable device in use at a third time in one example of the present disclosure;
FIG. 7 is a schematic illustration of the direction of movement of view 12 after entering the target interface in the example shown in FIG. 6 of the present disclosure;
FIG. 8 is a schematic flow chart of a step SC in one embodiment of the present disclosure;
FIG. 9 is a block diagram of an apparatus for displaying views in one embodiment of the present disclosure;
fig. 10 is a block diagram of an electronic device provided in an exemplary embodiment of the present disclosure.
Detailed Description
Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some of the embodiments of the present disclosure, and not all of the embodiments of the present disclosure, and it is to be understood that the present disclosure is not limited by the example embodiments described herein.
It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
It will be understood by those of skill in the art that the terms "first," "second," and the like in the embodiments of the present disclosure are used merely to distinguish one element from another, and are not intended to imply any particular technical meaning, nor is the necessary logical order between them.
It is also understood that in embodiments of the present disclosure, "a plurality" may refer to two or more and "at least one" may refer to one, two or more.
It is also to be understood that any reference to any component, data, or structure in the embodiments of the disclosure, may be generally understood as one or more, unless explicitly defined otherwise or stated otherwise.
In addition, the term "and/or" in the present disclosure is only one kind of association relationship describing an associated object, and means that three kinds of relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.
It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and the same or similar parts may be referred to each other, so that the descriptions thereof are omitted for brevity.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
The disclosed embodiments may be applied to electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with electronic devices, such as terminal devices, computer systems, servers, and the like, include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set top boxes, programmable consumer electronics, network pcs, minicomputer systems, mainframe computer systems, distributed cloud computing environments that include any of the above systems, and the like.
Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. The computer system/server may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
FIG. 1 is an exemplary system architecture diagram of an embodiment of a method or apparatus for displaying views that may be applied to the present disclosure.
As shown in fig. 1, the system architecture may include a head mounted display device 1, a network 2, and a server 3. The network 2 may be the medium between the head mounted display device 1 and the server 3 for the communication link. The network 2 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The head-mounted display device 1 may be an electronic device with an image display function, including but not limited to AR smart glasses, VR smart glasses, and the like. The head-mounted display device 1 may be a one-piece machine, i.e. the head-mounted display device 1 may install various client applications. Or, the head-mounted display device 1 may also be a split device used in cooperation with a terminal device to implement an image display function, and at this time, the terminal device may assume a calculation function of the head-mounted display device. Here, for convenience of representation, the all-in-one machine and the split type device may be collectively referred to as a head-mounted display device.
The head-mounted display device 1 may provide various services, such as controlling the first view and the first mask in the target interface to scroll after receiving the view scrolling instruction, and releasing the scroll processing resource of the first view after the first view leaves the view image display area of the target interface.
It should be noted that the method for displaying a view provided by the embodiment of the present disclosure is generally performed by the head-mounted electronic device 1, and accordingly, the apparatus for displaying a view is generally disposed in the head-mounted electronic device 1.
Optionally, the method for displaying the view provided by the embodiment of the present disclosure may also be performed by a terminal device connected to the head-mounted electronic device 1, and accordingly, the apparatus for displaying the view may also be disposed in the terminal device.
It should also be noted that, although the solution of the present disclosure may be applied to a head-mounted display device, it is not excluded that the solution may also be applied to the server 3, and the server 3 may be a background server. In the case that the scheme of the present disclosure is applied to the server 3, after receiving the view scrolling instruction, the server controls the first view and the first mask in the target interface to scroll, and releases the scroll processing resource of the first view after the first view leaves the view image display area of the target interface. In this case, the method for displaying the view may be performed by the server 3, and accordingly, the means for displaying the view may be provided in the server 3.
Exemplary method
FIG. 2 is a flow diagram of a method for displaying views in one embodiment of the present disclosure. The embodiment can be applied to a dual-screen stereoscopic display device, such as an AR head-mounted display device, a VR head-mounted display device, and the like, as shown in fig. 1. In this embodiment, as shown in fig. 2, the method for displaying a view may include the steps of:
s2: in response to receiving the view scrolling instruction, a view scrolling direction and a scrolling distance in a target interface displayed by the head mounted display device are determined.
The view scrolling instructions may be sent to the head mounted display device by a controller of the head mounted display device. The view scrolling instruction is used for controlling the view in the target interface displayed by the head-mounted display device to scroll. The controller may be a real controller that communicates with the head-mounted display device, for example, a control terminal such as a mobile phone. The controller may also be a virtual controller, for example, generated within a virtual area displayed by the head mounted display device.
The controller may render a target interface in which multiple views are currently displayed, for example, multiple views are displayed on the target interface in a row and column arrangement. FIG. 3 is a schematic illustration of a target interface at a first time in one example of the disclosure. As shown in FIG. 3, in the present example, the target interface displays 8 views at the first moment, and the 8 views are arranged in rows and columns to be displayed in 2 rows and 4 columns. Wherein, the x direction is the horizontal direction of the target interface, and the y direction is the vertical direction of the target interface.
And after receiving the view scrolling instruction, acquiring a view scrolling direction and a scrolling distance in a target interface displayed by the head-mounted display device through the view scrolling instruction. Wherein the view scrolling direction may be one of view scrolling up, view scrolling down, view scrolling left, and view scrolling right. Taking fig. 3 as an example, the view scrolling command may control the view in the target interface to scroll in the y-axis positive semi-axis direction, the y-axis negative semi-axis direction, the x-axis positive semi-axis direction, or the x-axis negative semi-axis direction. The scroll distance may be determined according to a distance indicated by the scroll command.
In general, the view scrolling instructions described above may be generated in a variety of ways. For example, the user generates a view scrolling instruction by sliding the target interface upwards, in this case, the view scrolling direction indicated by the view scrolling instruction may be the direction upwards along the target interface, and the view scrolling distance may be determined according to the distance the user slides on the target interface.
S4: and controlling the first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance. The target interface comprises at least one first view, a first mask covers partial area of the first view, the size of the first mask is smaller than that of the first view, and the scrolling speed of the first mask is larger than that of the first view.
The size of the first mask can be a size corresponding to the hollow part of the first mask frame, and the size is smaller than that of the first view, so that the part of the first view can be displayed through the first mask. It will be appreciated that the controller may render a first mask and a corresponding first view at different display depths, respectively, wherein the first mask is closer to the head mounted display device than the first view. The scrolling speed of the first mask is greater than that of the first view, and the content of the first view displayed through the first mask in the rendered image can be dynamically changed in the process of scrolling the first view and the first mask, so that a dynamic three-dimensional depth effect is generated.
It is to be understood that the device for displaying views of the present application may be a dual-screen stereoscopic display device, such as an AR head-mounted display device, a VR head-mounted display device, or the like. Therefore, the controller can render different objects at different display depths to perform stereoscopic display. For example, the controller may render the first view and the corresponding first mask at different display depths. Fig. 4 is a side view schematic diagram of a wearable device in use at a first time in one example of the present disclosure. As shown in fig. 3 and 4, the first view may include at least view 8. The first mask may comprise at least a mask 8 corresponding to the view 8, and the mask 8 is an outer frame mask. The z-axis direction is a display depth direction of the head-mounted display device, a dotted line direction between the mask 8 and the view 8 is parallel to the z-axis direction, and the depth of the mask 8 is smaller than that of the view 8.
In one example of the present disclosure, the background control may be used to control the view 8 for scrolling and the mask control may be used to control the mask 8 for scrolling. The manner of using the background control to control the view 8 to scroll may include: the background control acquires view rendering data of the view 8, which may include a rendering position, a rendering size and a rendering content of the view 8; the background control is used to control the view 8 to scroll the scroll distance in the view scroll direction. The manner in which the mask 8 is controlled to scroll using the mask control may include: the mask control acquires rendering data of the mask 8, including the rendering position, the rendering size and the rendering content of the mask 8; the mask control mask 8 is used to scroll the scroll distance in the view scroll direction.
At a first moment, due to the occlusion of the mask 8, the user can only see a partial area of the view 8 when viewing the view 8 using the head mounted display device. The partial area includes the area a of fig. 8.
Upon receiving the view scroll instruction, the background control and the mask control may be used to control the view 8 and the mask 8, respectively, to scroll. Since the size of the mask 8 is smaller than the size of the view 8 and the scrolling speed of the mask 8 is greater than the scrolling speed of the view 8, when the view 8 and the mask 8 are scrolled, the content of the view 8 can be seen through the mask 8, and can be updated along with the scrolling direction of the view, so that a strong three-dimensional stereoscopic impression can be provided for a user using the head-mounted display device.
Fig. 5 is a side view schematic of a wearable device in use at a second moment in one example of the disclosure. The second time may be a certain time after the view 8 scrolls according to the view scroll instruction. As shown in fig. 5, after the view 8 is scrolled, the position of the area a of the view 8 in the hollow area of the mask 8 is obviously changed due to the difference between the scrolling speeds of the view 8 and the mask 8.
S6: responsive to the first view scrolling away from the view display area of the target interface, the scroll processing resources of the first view are released.
During the process that the first view is scrolled according to the view scrolling direction and the scrolling distance in the view scrolling instruction, if the first view does not complete the scrolling distance in the view scrolling instruction, the first view leaves the view display area of the target interface, for example, the view scrolling direction is a first preset direction, the scrolling distance is L1, the distance between the first view and the boundary of the view display area of the target interface in the first preset scrolling direction is L2, and L1> L2. When the first view has scrolled a distance of L2, the distance of incomplete scrolling being L1, at which point the first view has left the view display area of the target interface, then the scroll processing resources of the first view are released, thereby avoiding the view away from the user's visual area from using the scroll processing resources to cause a system jam.
The scroll processing resource may include a control that controls the first view to scroll, for example, when the view 8 leaves the view display area of the target interface, a background control that controls the view 8 to scroll may be released, and a mask control that may release the mask 8 to scroll may also be released.
In this embodiment, after receiving the view scroll instruction, the first view and the first mask in the control target interface are scrolled. In the rolling process, the first view is shielded through the first shade, so that the visual area of the first view is continuously changed by the head-mounted display device, the changing feeling of the display internal movement can be brought to the depth of a user using the head-mounted display device, and the visual three-dimensional stereoscopic impression is improved. And when the first view leaves the view display area of the target interface, releasing the scroll processing resource of the first view, thereby reducing the probability of image stagnation caused by the scroll processing resource used by the view leaving the visual area of the user.
In an optional embodiment of the present disclosure, before step S2, the method may further include:
s0: a background control and a mask control are generated based on rendering data of the first view. The background control may control the first view to scroll, for example, the background control acquires view size information of the first view, the number of pixels included in the first view, and a pixel value of each pixel, and when the first view needs to be controlled to scroll, all pixels included in the first view may be controlled to move synchronously through the background control. The mask control may control the first mask to scroll, for example, the mask control obtains size information of the first mask, the number of pixels included in the first mask, and a pixel value of each pixel, and when the first mask needs to be controlled to scroll, the mask control may control all pixels included in the first mask to move synchronously.
In this embodiment, the background control and the mask control may be generated before the first view is scrolled, and the scroll control is high in accuracy by controlling the first view and the first mask to scroll through the background control and the mask control. It will be appreciated that the background control and corresponding mask control may also be generated based on the first view upon receiving a view scrolling instruction, without limitation.
In an optional embodiment of the present disclosure, after step S6, the method may further include:
s8: the scroll processing resource of the first view is multiplexed with the current view in the target interface. Wherein the scroll processing resource of the first view may include a control that controls the first view and the first mask to scroll.
In this embodiment, after the first view leaves the current display area of the target interface, the control controlling the first view and the first mask to scroll may be released, and the released control is multiplexed onto the newly appearing view in the target interface to control the newly appearing view to scroll.
In one embodiment of the present disclosure, the view scrolling direction includes a first preset direction, for example, the first preset direction may be a view scrolling up direction. The method for displaying a view may further include:
and SA-2: in response to receiving the view scrolling instruction, a second view and a second mask corresponding to the second view are rendered. The distance between the second view and the target interface in the depth direction is a preset distance, the second mask covers a partial area of the second view, and the size of the second mask can be smaller than that of the second view.
The target interface and the views in the target interface may be rendered prior to receiving the view scrolling instructions.
Upon receiving the view scrolling instruction, the second view may be rendered according to the view rendering data of the second view and the second mask may be rendered according to the rendering data of the second mask, where the display depth of the second view may be greater than the depth of the first view. That is, in the display depth direction, the first view is closer to the head mounted display device. It should be further noted that the second view and the second mask corresponding to the second view are at least partially occluded at the target interface.
It can be understood that, when the controller renders the second image, the controller sets the second mask corresponding to the second image, so that the second image only displays the content corresponding to the second mask hollow area, and the display area and the display content amount are controllable.
SA-4: and when the first view is scrolled along a first preset direction, controlling the second view and the second mask to move towards the direction close to the target interface so that the distance between the second image and the target interface in the depth direction is gradually reduced.
Fig. 6 is a side view schematic of a wearable device in use at a third time in one example of the present disclosure. Wherein the third time may be between the first time and the second time. As shown in fig. 3 and 6, in one example of the present disclosure, the second view may include a view 12, and when the first view is scrolled in a first preset direction, the view 12 is moved to a direction close to the target interface.
SA-6: and controlling the second view and the second mask to move along the first preset direction under the condition that the preset point of the first view is scrolled to the first critical line. The first critical line is a critical line of the target interface in a first preset direction, and the moving speed of the second mask in the first preset direction is greater than that of the second view in the first preset direction.
In an example of the present disclosure, the preset point of the first view may be a preset point of the first view in a first preset direction, for example, when the first preset direction is a view upward scrolling direction, the preset point of the first view may be one of pixel points between a first row of pixel points in a downward-upward direction of the first view. It is preset that when the preset point of the first view reaches the first critical line, the second view just reaches the target interface, and the second view stops moving in the direction of decreasing depth. FIG. 7 is a schematic illustration of the direction of movement of view 12 after entering the target interface in the example shown in FIG. 6 of the present disclosure. When the preset point of view 8 is scrolled to the first critical line as shown in fig. 7, the view 12 just reaches the target interface, and the depth of the view 12 may be the same as the display depth of the target interface. The view 12 may then continue to be controlled to move upward in accordance with the view scrolling instructions.
In this embodiment, when the view scrolling instruction is received, the second view and the second mask may be rendered, so that compared with a method of rendering the second view and the second mask in advance, the resource consumption of the system may be reduced, and the display stuck probability may be reduced. And the first view and the second view are respectively rendered at different display depths, and when the first view moves to a first preset direction, the second view is controlled to move to a direction close to the target interface, so that the change of the relative position of the views on the spatial depth can be embodied, and the three-dimensional visual perception is further enhanced. When the preset point of the first view is scrolled to the first critical line, the second view and the second mask can be controlled to move towards the first preset direction, the second view is shielded through the second mask, and the moving speed difference between the second mask and the second view enables the visual area of the second view to be continuously changed through the head-mounted display device, the depth change feeling can be brought to a user using the head-mounted display device, and the three-dimensional stereoscopic impression is improved.
In an embodiment of the present disclosure, in the process of controlling the second view to move to a direction close to the target interface, the method further includes: and controlling the transparency parameter of the second view to be increased as the distance between the second view and the target interface is reduced, so that the transparency of the second view is gradually increased. Wherein the greater the transparency of the second view, the clearer the second view; the smaller the transparency of the second view, the more blurred the second view.
In this embodiment, in the moving process of the second view to the direction close to the target interface, the transparency of the second view is controlled to be gradually increased, so that when a distant view gradually approaches the user, the view gradually becomes clear, and the three-dimensional display effect can be improved.
In one embodiment of the present disclosure, the view scrolling direction includes a second preset direction, for example, the second preset direction may be a view downward scrolling direction. The method for displaying a view may further include:
SC: and after the preset point of the first view is scrolled to the second critical line, controlling the first view to move in the direction away from the target interface so that the distance between the first image and the target interface in the depth direction is gradually increased. And the second critical line is a critical line of the target interface in a second preset direction.
In an example of the present disclosure, the preset point of the first view may be a preset point of the first view in a second preset direction, for example, when the first preset direction is a view-down scrolling direction, the preset point of the first view may be one of the first row of pixel points in a top-down direction of the first view. And when the preset point of the first view reaches a preset second critical line, the first view starts to move in a direction away from the target interface and the depth of the first view increases.
In this embodiment, after the preset point of the first view is scrolled to the second critical line, the first view is controlled to move towards the direction away from the target interface, so as to provide the user with a visual feeling that the first view gradually gets away from the user, and further improve the three-dimensional display effect.
In an embodiment of the present disclosure, during the moving of the first view away from the target interface, the method further includes: the transparency parameter controlling the first view decreases as the distance between the first view and the target interface increases. Wherein the greater the transparency of the first view, the clearer the first view; the smaller the transparency of the first view, the more blurred the first view.
In this embodiment, in the process of moving the first view away from the target interface, the transparency of the first view is controlled to be gradually reduced, so that when a near view of the user is gradually away from the user, the view is gradually blurred, and the three-dimensional display effect can be further improved.
Fig. 8 is a schematic flow chart of step SC in an embodiment of the present disclosure. As shown in fig. 8, step SC may include:
SC-2: and acquiring a distance difference value between the rolling distance and the preset point moving distance. And the preset point moving distance is the distance between the initial position of the preset point of the first view and the second critical line.
The initial position of the preset point of the first view is the position of the preset point of the first view in the target interface before the scrolling is performed according to the view scrolling instruction. In one example of the present disclosure, the scroll distance corresponding to the view scroll instruction is L1, the distance between the initial position of the preset point of the first view and the second critical line position is L2, and L1> L2. The difference in distance between the scrolling distance and the preset point movement distance is L3, where L3 is L1-L2.
SC-4: and determining the moving distance of the first view in the direction away from the target interface based on the distance difference and the moving distance conversion relation. The moving distance conversion relation is a distance conversion relation between the moving distance in the second preset direction and the moving distance in the direction far away from the target interface.
In one embodiment of the present disclosure, the moving distance transformation relationship is 1: and K, namely after the preset point of the first view is scrolled to the second critical line, the first view originally continues to move 1 unit distance in the second preset direction, and the first view is transformed to move K unit distances in the direction away from the target interface. Assuming that the moving distance of the first view in the direction away from the target interface is L4, L4 is K × L3.
In this embodiment, when the first view is controlled to scroll in the second preset direction according to the view scrolling instruction, if the critical point of the first view has not executed the scrolling distance corresponding to the view scrolling instruction when scrolling to the second critical line, the moving direction of the first view is changed, and the first view is controlled to move in the direction away from the target interface.
In an optional embodiment of the present disclosure, step S8 may further include:
when the preset point of the first view is scrolled to the second critical line, the first distance value is acquired. The first distance value is a distance value between an initial position of the preset point of the first view and the second critical line, and the initial position of the preset point of the first view is a position of the preset point of the first view before scrolling according to the view scrolling instruction.
Based on the scroll distance and the first distance value, a second distance value is determined. The distance value obtained by subtracting the first distance value from the distance value corresponding to the scroll distance may be used as the second distance value.
Based on the second distance value, a distance of movement of the first view in a direction away from the target interface is controlled. For example, after the preset point of the first view is scrolled to the second critical line, the preset point is moved by the second distance value in a direction away from the target interface.
In this embodiment, when the first view is controlled to scroll in the second preset direction according to the view scrolling instruction, if the critical point of the first view has not executed the scrolling distance corresponding to the view scrolling instruction when the first view is scrolled to the second critical line, the original moving direction of the first view is changed to continue moving, and by changing the view moving direction, the first view can move not only in the second preset direction at the same display depth, but also in different display depths, so that the three-dimensional visual effect can be enhanced.
In one embodiment of the present disclosure, step SA-6 includes: and under the condition that the preset point of the first view is scrolled to the first critical line, the second view moves to the target interface, and the second view is determined as the first view and then moves along the first preset direction. In this embodiment, after the second view is moved to the target interface, the second view may be determined as the first view in the target interface. After receiving the view scrolling instruction, the method provided by the embodiments may be executed to control the first view to move along the view scrolling direction. It is understood that the controller may render a new second view and a corresponding second mask while the scrolling direction is in the first predetermined direction.
In this embodiment, when the preset point of the first view is scrolled to the first critical line, the second view is just moved to the target interface, and thereafter the second view may be determined as the first view and moved along the first preset direction.
Any of the methods for displaying views provided by embodiments of the present disclosure may be performed by any suitable device having data processing capabilities, including but not limited to: terminal equipment, a server and the like. Alternatively, any of the methods for displaying a view provided by the embodiments of the present disclosure may be executed by a processor, for example, the processor may execute any of the methods for displaying a view mentioned by the embodiments of the present disclosure by calling a corresponding instruction stored in a memory. And will not be described in detail below.
Exemplary devices
FIG. 9 is a block diagram of an apparatus for displaying a view in one embodiment of the present disclosure. As shown in fig. 9, the apparatus for displaying a view includes:
the scrolling information determining module 100 is configured to determine, in response to receiving a view scrolling instruction, a view scrolling direction and a scrolling distance in a target interface displayed by the head-mounted display device;
a first view control module 200, configured to control a first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance, where the target interface includes at least one first view, the first mask blocks a partial area of the first view, a size of the first mask is smaller than a size of the first view, and a scrolling speed of the first mask is greater than a scrolling speed of the first view;
a scroll processing resource release module 300, configured to release the scroll processing resource of the first view in response to the first view scrolling away from the view display area of the target interface.
In one embodiment of the present disclosure, the apparatus for displaying a view may further include:
and the scroll processing resource multiplexing module is used for multiplexing the scroll processing resource of the first view for the current view in the target interface, wherein the scroll processing resource of the first view comprises a control for controlling the first view and the first shade to scroll.
In one embodiment of the present disclosure, the apparatus for displaying a view may further include:
the rendering module is used for rendering a second view and a second mask corresponding to the second view in response to receiving the view scrolling instruction, wherein the distance between the second view and the target interface in the depth direction is a preset distance, the second mask blocks a partial area of the second view, and the size of the second mask is smaller than that of the second view;
the second view control module is used for controlling the second view and the second mask to move towards the direction close to the target interface when the first view is scrolled along the first preset direction, so that the distance between the second image and the target interface in the depth direction is gradually reduced; the second view control module is further configured to control the second view and the second mask to move along the first preset direction when the preset point of the first view is scrolled to a first critical line, where the first critical line is a critical line of the target interface in the first preset direction, and a moving speed of the second mask along the first preset direction is greater than a moving speed of the second view along the first preset direction.
In an embodiment of the disclosure, the second view control module is further configured to control the transparency parameter of the second view to increase as the distance between the second view and the target interface decreases in the process of controlling the second view to move toward the target interface.
In an embodiment of the present disclosure, the first view control module 200 is further configured to control the first view to move in a direction away from the target interface after the preset point of the first view is scrolled to a second critical line, so that the distance between the first image and the target interface in the depth direction gradually increases, where the second critical line is a critical line of the target interface in the second preset direction.
In an embodiment of the present disclosure, the first view control module 200 is further configured to control the transparency parameter of the first view to decrease as the distance between the first view and the target interface increases during the process that the first view moves away from the target interface.
In an embodiment of the present disclosure, the first view control module 200 is configured to obtain a distance difference between the scroll distance and a preset point moving distance, where the preset point moving distance is a distance between the initial position of the first view and the second critical line; the first view control module 200 is further configured to determine a moving distance of the first view in a direction away from the target interface based on the distance difference and a moving distance transformation relationship, where the moving distance transformation relationship is a distance transformation relationship between the moving distance in the second preset direction and the moving distance in the direction away from the target interface.
In an embodiment of the disclosure, the second view control module is configured to, when the preset point of the first view is scrolled to the first critical line, move the second view to the target interface, and move the second view in the first preset direction after determining the second view as the first view.
It should be noted that the specific implementation of the apparatus for displaying a view according to the embodiment of the present disclosure is similar to the specific implementation of the method for displaying a view according to the embodiment of the present disclosure, and specific reference is specifically made to a method portion for displaying a view, and details are not described here in order to reduce redundancy.
Exemplary electronic device
Next, an electronic apparatus according to an embodiment of the present disclosure is described with reference to fig. 10. As shown in fig. 10, the electronic device includes one or more processors 10 and a memory 20.
The processor 10 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.
Memory 20 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by the processor 10 to implement the methods for displaying views of the various embodiments of the present disclosure described above and/or other desired functions. Various contents such as an input signal, a signal component, a noise component, etc. may also be stored in the computer-readable storage medium.
In one example, the electronic device may further include: an input device 30 and an output device 40, which are interconnected by a bus system and/or other form of connection mechanism (not shown). The input device 30 may be, for example, a keyboard, a mouse, or the like. Output devices 40 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, among others.
Of course, for simplicity, only some of the components of the electronic device relevant to the present disclosure are shown in fig. 10, omitting components such as buses, input/output interfaces, and the like. In addition, the electronic device may include any other suitable components, depending on the particular application.
Exemplary computer readable storage Medium
A computer-readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
In addition, the embodiment of the disclosure also provides a head-mounted display device which comprises the device for displaying the view of the embodiment.
The foregoing describes the general principles of the present disclosure in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present disclosure are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present disclosure. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the disclosure is not intended to be limited to the specific details so described.
In the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts in the embodiments are referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The block diagrams of devices, apparatuses, systems referred to in this disclosure are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably herein. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
It is also noted that in the devices, apparatuses, and methods of the present disclosure, each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be considered equivalents of the present disclosure.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (12)

1. A method for displaying a view, comprising:
in response to receiving the view scrolling instruction, determining a view scrolling direction and a scrolling distance in a target interface displayed by the head-mounted display device;
controlling a first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance, wherein the target interface comprises at least one first view, the first mask covers a partial area of the first view, the size of the first mask is smaller than that of the first view, and the scrolling speed of the first mask is greater than that of the first view;
releasing the scrolling processing resources of the first view in response to the first view scrolling away from the view display area of the target interface.
2. The method of claim 1, further comprising, after said releasing scrolling processing resources of said first view:
multiplexing a scroll processing resource of the first view for a current view in the target interface, wherein the scroll processing resource of the first view includes a control that controls the first view and the first mask to scroll.
3. The method of claim 1, wherein the view scrolling direction is a first preset direction, the method further comprising:
in response to receiving the view scrolling instruction, rendering a second view and a second mask corresponding to the second view, wherein the second view is at a preset distance from the target interface in the depth direction, the second mask blocks a partial area of the second view, and the size of the second mask is smaller than that of the second view;
when the first view is scrolled along the first preset direction, controlling the second view and the second mask to move towards the direction close to the target interface so that the distance between the second image and the target interface in the depth direction is gradually reduced;
and under the condition that the preset point of the first view is scrolled to a first critical line, controlling the second view and the second mask to move along the first preset direction, wherein the first critical line is a critical line of the target interface in the first preset direction, and the moving speed of the second mask along the first preset direction is greater than that of the second view along the first preset direction.
4. The method of claim 3, wherein in controlling the second view to move closer to the target interface, further comprising:
controlling a transparency parameter of the second view to increase as a distance between the second view and the target interface decreases.
5. The method of claim 1, wherein the view scrolling direction is a second preset direction, the method further comprising:
after the preset point of the first view is scrolled to a second critical line, controlling the first view to move in a direction away from the target interface so as to gradually increase the distance between the first image and the target interface in the depth direction, wherein the second critical line is the critical line of the target interface in the second preset direction.
6. The method of claim 5, wherein during the movement of the first view in a direction away from the target interface, further comprising:
controlling a transparency parameter of the first view to decrease as a distance between the first view and the target interface increases.
7. The method of claim 5, wherein the controlling the first view to move away from the target interface comprises:
acquiring a distance difference between the rolling distance and a preset point moving distance, wherein the preset point moving distance is a distance between an initial position of the first view preset point and the second critical line;
and determining the moving distance of the first view along the direction far away from the target interface based on the distance difference and a moving distance conversion relation, wherein the moving distance conversion relation is the distance conversion relation between the moving distance in the second preset direction and the moving distance in the direction far away from the target interface.
8. The method according to claim 3, wherein said controlling the second view to move in the first preset direction in case of scrolling the preset point of the first view to a first critical line comprises:
and when the preset point of the first view is scrolled to a first critical line, the second view moves to the target interface, and the second view is determined as the first view and then moves along the first preset direction.
9. An apparatus for displaying a view, comprising:
the scroll information determining module is used for responding to the received view scrolling instruction and determining the scroll direction and the scroll distance of the view in the target interface displayed by the head-mounted display equipment;
a first view control module, configured to control a first view and a first mask corresponding to the first view to scroll based on the view scrolling direction and the scrolling distance, where the target interface includes at least one first view, the first mask blocks a partial area of the first view, a size of the first mask is smaller than a size of the first view, and a scrolling speed of the first mask is greater than a scrolling speed of the first view;
and the scroll processing resource releasing module is used for responding to the first view scrolling to leave the view display area of the target interface and releasing the scroll processing resource of the first view.
10. A head mounted display device comprising the apparatus for displaying a view of claim 9.
11. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor configured to read the executable instructions from the memory and execute the instructions to implement the method for displaying a view of any of claims 1-8.
12. A computer-readable storage medium, having stored thereon a computer program for executing the method for displaying views according to any of the claims 1-8.
CN202210296801.1A 2022-03-24 2022-03-24 Method and device for displaying view and head-mounted display device Pending CN114610217A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210296801.1A CN114610217A (en) 2022-03-24 2022-03-24 Method and device for displaying view and head-mounted display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210296801.1A CN114610217A (en) 2022-03-24 2022-03-24 Method and device for displaying view and head-mounted display device

Publications (1)

Publication Number Publication Date
CN114610217A true CN114610217A (en) 2022-06-10

Family

ID=81865804

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210296801.1A Pending CN114610217A (en) 2022-03-24 2022-03-24 Method and device for displaying view and head-mounted display device

Country Status (1)

Country Link
CN (1) CN114610217A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102782633A (en) * 2010-02-12 2012-11-14 微软公司 Multi-layer user interface with flexible parallel and orthogonal movement
US20140160168A1 (en) * 2012-12-07 2014-06-12 Research In Motion Limited Methods and devices for scrolling a display page
US20140173504A1 (en) * 2012-12-17 2014-06-19 Microsoft Corporation Scrollable user interface control
CN104951317A (en) * 2014-03-26 2015-09-30 北京奇虎科技有限公司 Image loading device and method
CN105556948A (en) * 2013-09-16 2016-05-04 汤姆逊许可公司 Method and apparatus for caption parallax over image while scrolling
CN106708478A (en) * 2015-07-21 2017-05-24 阿里巴巴集团控股有限公司 Scroll view display method and device
US20170193566A1 (en) * 2014-02-03 2017-07-06 Google Inc. Scrolling Interstitial Advertisements
CN106990886A (en) * 2017-04-01 2017-07-28 维沃移动通信有限公司 The mobile display methods and mobile terminal of a kind of icon
CN110620916A (en) * 2018-12-29 2019-12-27 北京时光荏苒科技有限公司 Method and apparatus for processing image
CN113110783A (en) * 2021-04-16 2021-07-13 北京字跳网络技术有限公司 Control display method and device, electronic equipment and storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102782633A (en) * 2010-02-12 2012-11-14 微软公司 Multi-layer user interface with flexible parallel and orthogonal movement
US20140160168A1 (en) * 2012-12-07 2014-06-12 Research In Motion Limited Methods and devices for scrolling a display page
US20140173504A1 (en) * 2012-12-17 2014-06-19 Microsoft Corporation Scrollable user interface control
CN105556948A (en) * 2013-09-16 2016-05-04 汤姆逊许可公司 Method and apparatus for caption parallax over image while scrolling
US20170193566A1 (en) * 2014-02-03 2017-07-06 Google Inc. Scrolling Interstitial Advertisements
CN104951317A (en) * 2014-03-26 2015-09-30 北京奇虎科技有限公司 Image loading device and method
US20170123617A1 (en) * 2014-03-26 2017-05-04 Beijing Qihoo Technology Company Limited Picture loading apparatus and method
CN106708478A (en) * 2015-07-21 2017-05-24 阿里巴巴集团控股有限公司 Scroll view display method and device
CN106990886A (en) * 2017-04-01 2017-07-28 维沃移动通信有限公司 The mobile display methods and mobile terminal of a kind of icon
CN110620916A (en) * 2018-12-29 2019-12-27 北京时光荏苒科技有限公司 Method and apparatus for processing image
CN113110783A (en) * 2021-04-16 2021-07-13 北京字跳网络技术有限公司 Control display method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US10962780B2 (en) Remote rendering for virtual images
US9424767B2 (en) Local rendering of text in image
CN107660338B (en) Stereoscopic display of objects
JP7270661B2 (en) Video processing method and apparatus, electronic equipment, storage medium and computer program
CN111414225B (en) Three-dimensional model remote display method, first terminal, electronic device and storage medium
EP3757727B1 (en) Image re-projection for foveated rendering
CN107204044B (en) Picture display method based on virtual reality and related equipment
US20240005625A1 (en) Image processing method and apparatus, electronic device and storage medium
CN107861711B (en) Page adaptation method and device
CN111796826B (en) Bullet screen drawing method, device, equipment and storage medium
CN112835484A (en) Dynamic display method and device based on operation body, storage medium and electronic equipment
US20220172440A1 (en) Extended field of view generation for split-rendering for virtual reality streaming
CN113589926B (en) Virtual interface operation method, head-mounted display device and computer readable medium
EP3876082B1 (en) Environment application model
CN114610217A (en) Method and device for displaying view and head-mounted display device
CN117319725A (en) Subtitle display method, device, equipment and medium
CN106375188B (en) Method, device and system for presenting interactive expressions
CN115576470A (en) Image processing method and apparatus, augmented reality system, and medium
CN111052110A (en) Method, apparatus and computer program for overlaying a webpage on a 3D object
CN113986168A (en) Image display method, device, equipment and readable storage medium
CN108197248B (en) Method, device and system for displaying 3D (three-dimensional) 2D webpage
US11962743B2 (en) 3D display system and 3D display method
KR101953567B1 (en) Method for postprocessing contents in virtual reallity services
WO2016032303A1 (en) Method and system for controlling scroll on basis of context information, and non-temporal computer-readable recording medium
CN117994284A (en) Collision detection method, collision detection device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination