CN117908722B - Mobile sliding screen control method, system and medium based on digital twin technology - Google Patents
Mobile sliding screen control method, system and medium based on digital twin technology Download PDFInfo
- Publication number
- CN117908722B CN117908722B CN202311792690.4A CN202311792690A CN117908722B CN 117908722 B CN117908722 B CN 117908722B CN 202311792690 A CN202311792690 A CN 202311792690A CN 117908722 B CN117908722 B CN 117908722B
- Authority
- CN
- China
- Prior art keywords
- digital twin
- display screen
- twin model
- target
- scrolling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000005516 engineering process Methods 0.000 title claims abstract description 30
- 230000008859 change Effects 0.000 claims abstract description 10
- 238000013507 mapping Methods 0.000 claims abstract description 10
- 238000005096 rolling process Methods 0.000 claims description 28
- 230000007704 transition Effects 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 4
- GNFTZDOKVXKIBK-UHFFFAOYSA-N 3-(2-methoxyethoxy)benzohydrazide Chemical compound COCCOC1=CC=CC(C(=O)NN)=C1 GNFTZDOKVXKIBK-UHFFFAOYSA-N 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 4
- 230000000694 effects Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000005286 illumination Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the disclosure provides a mobile sliding screen control method, a mobile sliding screen control system and a mobile sliding screen control medium based on a digital twin technology, wherein the method comprises the following steps: establishing a digital twin model of the digital product; mapping the digital twin model to a display screen according to a preset rule; detecting sliding operation of a user, and updating the position of the digital twin model on the display screen according to the sliding direction and the distance; according to the position change of the digital twin model, the content of the display screen is automatically adjusted, so that a user can quickly see the information of the target exhibit. Through the processing scheme disclosed by the invention, the experience of the user is improved.
Description
Technical Field
The invention relates to the technical field of sliding screen control, in particular to a mobile sliding screen control method, a mobile sliding screen control system and a mobile sliding screen control medium based on a digital twin technology.
Background
In modern digital product display scenarios, the exhibit information is typically presented in digitized form through a screen. The visitor can browse the information of different exhibits through the sliding screen, obtain detailed product parameters, characteristics and use instructions, etc. However, in the actual operation process, because the control mode of the sliding screen is relatively single, the requirement of the user on quick positioning of the specific exhibits cannot be met, and the user experience is reduced.
Disclosure of Invention
The invention provides a mobile sliding screen control method based on a digital twin technology, which mainly solves the problem of how to help a user to quickly locate and view interesting exhibit information in a sliding screen control mode under a digital product display scene.
The invention discloses a mobile sliding screen control method based on a digital twin technology, which comprises the following steps:
establishing a digital twin model of the digital product;
Mapping the digital twin model to a display screen according to a preset rule;
Detecting sliding operation of a user, and updating the position of the digital twin model on the display screen according to the sliding direction and the distance;
according to the position change of the digital twin model, the content of the display screen is automatically adjusted, so that a user can quickly see the information of the target exhibit.
Preferably, the detecting the sliding operation of the user and updating the position of the digital twin model on the display screen according to the sliding direction and the distance includes the following steps:
a) Detecting a sliding operation of a user on the display screen through a touch sensor;
b) Calculating the sliding direction and the sliding distance of the user;
c) Judging whether the sliding direction accords with a preset rule, and if not, returning to the step a; otherwise, executing the step d;
d) And updating the position of the digital twin model on the display screen according to the calculated sliding direction and distance.
Preferably, the updating the position of the digital twin model on the display screen according to the calculated sliding direction and distance comprises the following steps:
e) Calculating the position coordinates of the current digital twin model;
f) C, judging whether the current position coordinates exceed the range of the display screen, and if so, returning to the step c; otherwise, executing the step g;
g) Calculating a target position coordinate;
h) The digital twin model is smoothly transitioned from the current position to the target position.
Preferably, said smoothly transitioning the digital twin model from the current location to the target location comprises the steps of:
i) Calculating the distance between the current position and the target position;
j) Setting a smooth transition time period;
k) In each time period, calculating the moving distance in the next time period according to the distance between the current position and the target position and the remaining time;
l) updating the position coordinates of the digital twin model.
Preferably, the updating the position coordinates of the digital twin model includes the steps of:
m) if the distance between the new position coordinate of the digital twin model and the target position coordinate is smaller than the set threshold value, setting the position coordinate of the digital twin model as the target position coordinate, and finishing smooth transition; otherwise, continuing to execute the step k.
Preferably, the setting the position coordinates of the digital twin model as the target position coordinates, and completing the smooth transition includes the following steps:
n) if the digital twin model has reached the target position, but the user still slides continuously, judging whether the sliding direction and the sliding distance of the user meet the preset conditions, and if so, updating the target position of the digital twin model; otherwise, the current position of the digital twin model is kept unchanged.
Preferably, the content of the display screen is automatically adjusted according to the position change of the digital twin model, so that the user can quickly view the information of the target exhibit, and the method specifically comprises the following steps:
acquiring the current position of the digital twin model on a display screen;
judging whether the current position is in the display area of the target exhibit or not;
if yes, directly displaying the information of the target exhibit;
if not, calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and direction until the display area of the target exhibit appears on the screen.
Preferably, the calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and direction until the display area of the target exhibit appears on the screen specifically includes the following steps:
Calculating a linear distance D between the current position and a display area of the target exhibit;
Determining a scrolling speed V and a scrolling direction theta of a display screen;
According to the formula: t=d/V, calculating the minimum time T required to scroll to the display area of the target exhibit;
judging whether T is smaller than a preset time threshold T0 or not; if yes, scrolling the display screen at the speed V and the direction theta;
if not, the scrolling speed or direction is adjusted, and the scrolling time is recalculated until the condition is met.
Preferably, the determining whether T is smaller than a preset time threshold T0; if yes, scrolling the display screen at the speed V and the direction theta; if not, the rolling speed or direction is adjusted, and the rolling time is recalculated until the condition is met, and the method specifically comprises the following steps:
if T > T0, increasing the scrolling speed V and recalculating the scrolling time T;
If T is still greater than T0, changing the rolling direction theta and recalculating the rolling time T;
Repeating the above steps until T < = T0, and then scrolling the display screen at a speed V and a direction θ.
Preferably, if T is still greater than T0, the scrolling direction θ is changed, and the scrolling time T is recalculated, which specifically includes the following steps:
calculating an included angle alpha between a connecting line of a display area of the current position and the target exhibit and the current rolling direction;
judging whether alpha is smaller than 90 degrees; if yes, the rolling direction is adjusted to the left; if not, the rolling direction is adjusted to the right;
And recalculating the rolling time T according to the adjusted rolling direction.
Preferably, the recalculating the rolling time T according to the adjusted rolling direction specifically includes the following steps:
calculating an included angle beta between the rolling direction after adjustment and the connecting line of the current position and the display area of the target exhibit;
according to the formula: t '=t (1- β/90), calculating a scroll time T' after adjusting the scroll direction;
Judging whether T' is smaller than a preset time threshold T0; if yes, scrolling the display screen in the adjusted scrolling direction; if not, the scrolling direction is adjusted again until the condition is met.
According to the mobile sliding screen control method based on the digital twin technology, the user experience can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.
FIG. 1 is a flowchart of a mobile sliding screen control method based on a digital twinning technique provided in an embodiment of the present disclosure;
FIG. 2 is a flowchart of detecting a sliding operation of a user on a display screen and updating a position of a digital twin model on the display screen according to a sliding direction and a distance provided by an embodiment of the present disclosure;
FIG. 3 is a flow chart for updating the position of a digital twin model on a presentation screen by calculating the sliding direction and distance provided by an embodiment of the present disclosure;
FIG. 4 is a flow chart for transitioning a digital twin model from a current location to a target location by a smooth transition provided by an embodiment of the present disclosure;
FIG. 5 is a flow chart for setting the position coordinates of a digital twin model as target position coordinates provided by an embodiment of the present disclosure;
fig. 6 is a flowchart of content of a presentation screen by automatic adjustment provided in an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
Other advantages and effects of the present disclosure will become readily apparent to those skilled in the art from the following disclosure, which describes embodiments of the present disclosure by way of specific examples. It will be apparent that the described embodiments are merely some, but not all embodiments of the present disclosure. The disclosure may be embodied or practiced in other different specific embodiments, and details within the subject specification may be modified or changed from various points of view and applications without departing from the spirit of the disclosure. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
It should also be noted that the illustrations provided in the following embodiments merely illustrate the basic concepts of the disclosure by way of illustration, and only the components related to the disclosure are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complicated.
In addition, in the following description, specific details are provided in order to provide a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects may be practiced without these specific details.
First, with reference to fig. 1, this mobile sliding screen control method based on digital twin technology is described in detail, and includes:
s100: and establishing a digital twin model of the digital product. The digital twin model is to perform virtual modeling on a real product and generate a virtual model corresponding to the real product in a computer. The real product can be converted into three-dimensional point cloud data by using a 3D scanner or other related equipment, and is processed and optimized by using computer software, so that a digital twin model for highly restoring the characteristics and the morphology of the real product is finally generated.
S200: and mapping the digital twin model to a display screen according to a preset rule. The presentation screen may be a touch screen on a mobile device such as a smart phone, tablet computer, or the like. Through preset rules, the position and the size of the digital twin model on the display screen can be determined, and good correspondence between the digital twin model and a real product is ensured.
S300: when the user performs a sliding operation, the system detects the sliding direction and distance of the finger of the user on the touch screen, and updates the position of the digital twin model on the display screen according to the information. In one embodiment, when the user slides the finger to the right, the system will correspondingly move the digital twin model a distance to the right; when the user slides the finger to the left, it is moved to the left. By monitoring and updating the position of the digital twin model in real time, synchronization with the sliding operation of the user can be achieved.
S400: after the position of the digital twin model changes, the system automatically adjusts the content on the presentation screen. Thus, the user can quickly look up the information of the target exhibit. In one embodiment, in a virtual museum application, when a user slides his finger to switch different exhibits, the system automatically loads and displays the relevant content such as detailed description, pictures, videos, etc. of the corresponding exhibit. In this way, the user can more conveniently understand and enjoy the respective exhibits.
In addition to the basic functions described above, in one embodiment, a deep learning algorithm may be employed to perform image recognition and feature extraction when building the digital twin model to improve the degree of matching between the digital twin model and the real product; when the sliding operation of the user is detected, a machine learning algorithm can be introduced to carry out advanced processing such as gesture recognition, intention analysis and the like; personalized recommendation and the like can also be performed according to user preference and historical behavior when the display screen content is automatically adjusted.
In one embodiment, a smart phone application is assumed, and a user can perform a sliding operation by touching a screen. First, a digital twin model corresponding to the actual product is built in the application program. This model may contain information about the appearance, function, and interaction elements of the product. And then, mapping the digital twin model to a mobile phone screen according to preset rules, and ensuring that the digital twin model is consistent with an actual product.
When a user performs sliding operations on the mobile phone screen, the application program detects the operations and updates the position of the digital twin model on the mobile phone screen according to the sliding direction and the distance. In one embodiment, if the user slides the finger to the right, the application will correspondingly move the digital twin model a distance to the right.
Finally, when the position of the digital twin model changes each time, the application program can automatically adjust the content displayed on the mobile phone screen. In one embodiment, if the user slides a finger to view different exhibit information, the application will switch the content on the display screen according to the change in position of the digital twinning model so that the user can quickly view the information of the target exhibit.
Through the mobile sliding screen control method based on the digital twin technology, a user can interact with a digital product more intuitively, and can browse and acquire required information quickly.
In addition, the digital twin model for establishing the digital product based on the mobile sliding screen control method of the digital twin technology comprises the following steps:
Acquiring a three-dimensional model of a digital product: the geometric and structural information of the digital product is obtained by scanning, modeling software, or other means.
Adding material and texture information to the three-dimensional model: according to the appearance characteristics of the actual product, the proper materials and textures are applied to the three-dimensional model so as to enable the three-dimensional model to present a sense of reality in a display system.
Setting the illumination effect of the three-dimensional model: by adjusting parameters such as the position, the intensity, the color and the like of the light source, a vivid illumination effect is created for the three-dimensional model, and the visual expressive force of the three-dimensional model is enhanced.
Importing the three-dimensional model into a display system: the processed three-dimensional model is imported into a presentation system used by the mobile slide control system so that a user can interact with the digital twinning through mobile slide operation.
For example, the geometry of a particular product (e.g., a cell phone) may be obtained using specialized modeling software (e.g., autoCAD) and imported into a virtual reality development platform. The digital product then has a realistic appearance in a virtual environment by adding appropriate material and texture information (e.g., metallic appearance, glass texture, etc.) to the platform. Next, by adjusting the light source parameters, a realistic lighting effect is created for the digital product, simulating natural or artificial lighting in different scenes in one embodiment. Finally, the processed three-dimensional model is imported into a display device (such as a tablet computer) used by the mobile sliding screen control system, and a user can interact with the digital twin through a sliding gesture and obtain an immersive experience.
In a specific embodiment, the mobile screen sliding control method based on the digital twin technology disclosed by the disclosure maps a digital twin model onto a display screen according to a preset rule, so as to realize control of the digital twin model in mobile screen sliding operation, and the method specifically comprises the following steps:
First, coordinates of a digital twin model in a three-dimensional space are determined: first, according to the input data or the information collected by the sensor, the position and the posture of the digital twin model in the three-dimensional space are determined.
Then, the projection area of the display screen in the three-dimensional space is calculated: and calculating the occupied area of the display screen in the three-dimensional space according to the parameters and the position information of the display screen.
Then, calculating two-dimensional coordinates of the digital twin model on the display screen according to a preset mapping rule: and converting the coordinates of the digital twin model in the three-dimensional space into corresponding two-dimensional coordinates by using a preset mapping rule. This process may involve projection, scaling, rotation, etc. transformation operations.
Finally, mapping the digital twin model onto a display screen according to the calculated two-dimensional coordinates: and finally, applying the two-dimensional coordinates obtained after conversion to a display screen to realize the movement control of the digital twin model in the screen sliding operation.
Next, with reference to fig. 2, a description will be given of detecting a sliding operation of a user on a display screen, and updating a position of a digital twin model on the display screen according to a sliding direction and a distance, which specifically includes the following steps:
s201: the sliding operation of the user on the presentation screen is detected by the touch sensor.
S202: the sliding direction and distance of the user are calculated.
S203: judging whether the sliding direction accords with a preset rule, and if not, returning to S201; otherwise, S204 is performed.
S204: and updating the position of the digital twin model on the display screen according to the calculated sliding direction and distance.
In one embodiment, assume that a user performs a left-right sliding operation on a mobile phone screen using a finger. First, the touch sensor detects this operation. Then, the system calculates the horizontal displacement of the user's finger from the start point to the end point as the sliding distance, and determines it as the horizontal direction. Then, the system will judge whether this horizontal direction accords with the preset rule (only allow left and right sliding in an embodiment), if not accord with, restart to detect the new round of operation of the user; if so, this horizontal displacement is applied to the digital twin model, and the position of the model is updated on the presentation screen. It should be understood that allowing only left-right sliding is an exemplary rule, and that other preset rules may be set.
Through the steps, the method can update the position of the digital twin model on the display screen according to the sliding operation of the user, so that the mobile sliding screen control is realized.
In a specific embodiment, referring to fig. 3, updating the position of the digital twin model on the display screen by calculating the sliding direction and distance specifically includes:
S301: calculating the position coordinates of the current digital twin model: and calculating the position coordinates of the current digital twin model on the display screen according to the existing data and algorithm.
S302: judging whether the current position coordinates exceed the display screen range or not: and judging whether the range is out or not by comparing the current position coordinates with the size of the display screen. If yes, returning to the previous step S203, and judging whether the sliding direction meets the preset rule; otherwise, continuing to execute the next step.
Since the normal sliding operation is a process of interaction between a person and the device, if the current position coordinate exceeds the range of the display screen, there is a high possibility that an error operation or the like occurs, and thus the sliding direction needs to be judged again.
S303: calculating target position coordinates: and calculating the target position coordinate according to parameters such as the sliding direction, the distance and the like and combining the current position coordinate.
S304: smooth transition to target position: the digital twin model is smoothly transited from the current position to the target position by properly adjusting the display effect of the digital twin model on the display screen or adopting a smooth transition animation mode and the like.
Assuming a mobile application, digital twinning technology is used in the application to realize the sliding screen control. The user can move the position of the digital twin model by sliding a finger over the touch screen.
First, it is necessary to acquire the sliding direction and distance information of the user. This can be accomplished by a touch screen event monitor that records the initial coordinates as the user begins to slide, and continuously updates the current coordinates and calculates the direction and distance of the slide during the sliding process.
Then, corresponding calculation is performed in the application program according to the position coordinates of the current digital twin model. In one embodiment, the target position coordinates may be calculated using a mathematical formula or a matrix operation, or the like.
Next, some visual effect or transitional animation may be employed to increase the user experience when smoothly transitioning to the target location. In one embodiment, the properties of transparency, size or shape are gradually changed during the movement of the digital twin model, so that the movement looks smoother and more natural.
And finally, after the target position is reached, updating the display state of the digital twin model on the display screen, and waiting for the next user operation.
In one particular embodiment, as shown in fig. 4, a mobile slide control method based on digital twinning technique of the present disclosure, wherein a digital twinning model is transitioned from a current position to a target position by a smooth transition. The specific implementation steps comprise the following aspects:
S401: calculating the distance between the current position and the target position: from the known current position and target position coordinates, a suitable calculation method (e.g., euclidean distance) is used to determine the distance between the two.
S402: setting a smooth transition time period: and setting a proper time period to finish the whole smooth transition process according to the system requirements and the user experience requirements. The time period can be a fixed value, and can be dynamically adjusted according to specific situations, for example, the time period of smooth transition can be shortened as the distance between the current position and the target position is reduced.
S403: calculating a moving distance in a next time period in each time period: in each time period, the distance to be moved in the next time period is calculated by taking into account the distance between the current position and the target position and the remaining time, using an appropriate algorithm or formula. This ensures that the target position is smoothly approached during each time period.
S404: updating the position coordinates of the digital twin model: and updating the position coordinates of the digital twin model in the corresponding axial direction (such as X, Y, Z axes) in the space at each updating time according to the calculated distance to be moved in the next time period. By continuously updating the position coordinates of the model, a smooth transition effect can be achieved.
For example, assume that there is a game application operating based on a touch screen, and a player needs to control a game character to move in a virtual scene by sliding a finger on the screen. Using the method described by this feature, smooth and continuous movement of the game character from the current position to the player-designated target position can be achieved.
First, each time the user touches the screen and begins to slide, the system records the initial touch point and the current location coordinates of the game character. Then, according to the displacement amount generated by the sliding gesture of the user on the screen and preset sensitivity parameters, the new position to which the user expects to move the game character is calculated.
Next, in each fixed time period (e.g., every second), the system calculates the distance the character should move during that time period based on the distance between the current position and the target position and the set smooth transition time period. This calculation may be based on linear interpolation or other suitable mathematical model.
Then, at the end of each time period, the system updates the position coordinates of the game character in the virtual scene according to the movement distance calculated in the previous step. By repeating these steps, the game character will smoothly transition from the initial position to the user-specified target position. By repeating the above steps until a set time period is reached or the digital twin model approaches the target position, the effect of smooth transition from the current position to the target position can be achieved.
In a specific embodiment, in a mobile sliding screen control method based on a digital twin technology, updating a position coordinate of a digital twin model. The method specifically comprises the following steps:
if the distance between the new position coordinate of the digital twin model and the target position coordinate is smaller than the set threshold value, setting the position coordinate of the digital twin model as the target position coordinate, and finishing smooth transition; otherwise, the step S403 is continued.
This feature enables a smooth transition by determining whether the distance between the new position of the current digital twin model and the target position is less than a set threshold. If the distance is smaller than the threshold value, the position of the digital twin model is directly set as the target position, so that the smooth transition effect is achieved. If the distance is greater than or equal to the threshold, then additional steps need to be performed to further adjust and update the position of the digital twin model.
In one embodiment, a mobile sliding screen control system based on digital twin technology is assumed, and when a user's finger slides on the touch screen, the system updates the position of a corresponding object (such as a game character, an image, etc.) on the display screen in the virtual environment according to the path that the user's finger makes on the touch screen.
When the finger of the user slides from the point A to the point B, the system updates the position of the object in the virtual environment in real time according to the digital twin model. During each update, the system calculates the distance between the new position coordinates of the current digital twin model and the target position coordinates. If the distance is less than the set threshold, the system will set the position of the digital twin model directly to the target position coordinates to complete the smooth transition. In one embodiment, when the distance between the new position of the digital twin model and the target position is smaller than the set threshold (e.g., 10 pixels) during the sliding of the finger of the user from the point a to the point B, the system immediately sets the position of the digital twin model as the target position and exhibits a smooth and consistent movement effect on the display screen.
In a specific embodiment, as shown in fig. 5, a mobile sliding screen control method based on a digital twin technology of the present disclosure, in which the position coordinates of a digital twin model are set as target position coordinates when a smooth transition is completed. The specific implementation steps are as follows:
S501: it is determined whether the digital twin model has reached the target location.
S502: if the digital twin model has reached the target location, but the user is still continuously sliding, the following determination is made:
s503: and judging whether the sliding direction and the sliding distance of the user meet preset conditions or not.
S504: if the sliding direction and the sliding distance of the user meet the preset conditions, updating the target position of the digital twin model to be a new target position. If the sliding direction and the sliding distance of the user do not meet the preset conditions, the current position of the digital twin model is kept unchanged.
Assuming a mobile application, there is a movable object (game character, graphic element, etc. in one embodiment) in the application and digital twinning techniques are used to track the position of the object on the screen in real time.
First, a digital twin model is created in the application program, and its initial position coordinates are set as actual position coordinates of the current object on the screen.
When a user drags on the screen through a finger, the application program can update the target position coordinates of the digital twin model into the target position dragged by the user in real time.
After the user stops dragging the finger, the application program judges and processes according to the characteristics:
If the digital twin model has reached the target location, then the next step is entered.
If the user still continues to slide the finger and the preset conditions (direction and distance in one embodiment) are met, the target position of the digital twin model is updated to a new target position.
If the user continuously slides the finger but does not meet the preset condition, the current position of the digital twin model is kept unchanged.
Through the above steps, this feature can enable the use of digital twinning techniques in mobile applications to control the smooth transitional effect of a movable object.
In a specific embodiment, the mobile sliding screen control method based on the digital twin technology enables a user to quickly look up information of a target exhibit by automatically adjusting the content of a display screen.
The method comprises the following specific steps:
acquiring the current position of the digital twin model on a display screen;
Judging whether the current position is in the display area of the target exhibit, if so, directly displaying the information of the target exhibit; if not, calculating the distance between the current position and the target exhibit display area, and scrolling the display screen at a preset speed and direction until the target exhibit display area appears on the screen.
In one embodiment, the method is used in a virtual museum application. Suppose a user is browsing a digital twin model of different artwork in a museum. When a user slides the mobile phone screen, the system can adjust in real time according to the position of the digital twin model on the screen. If the user slides to the vicinity of a certain artwork and stops, the system determines whether the position is within the display area corresponding to the artwork. If so, the system will immediately display the artwork-related information on the screen for viewing by the user. If not, the system calculates the distance between the current position and the target artwork display area and scrolls the screen at a preset speed and direction until the target artwork display area appears on the screen. In this way, the user can quickly view information of different artwork through the sliding screen, and the system automatically adjusts the presentation content to provide a better user experience.
In a specific embodiment, as shown in fig. 6, a mobile sliding screen control method based on digital twin technology of the present disclosure is implemented by calculating a distance between a current position and a display area of a target exhibit, and scrolling a display screen according to a preset speed and direction until the display area of the target exhibit appears on the screen. The specific implementation steps are as follows:
s601: and calculating the linear distance D between the current position and the display area of the target exhibit.
S602: the scroll speed V and the scroll direction θ of the presentation screen are determined.
S603: the minimum time T required to scroll to the target exhibit is calculated using the formula t=d/V,
And judging whether T is smaller than a preset time threshold T0. If so, scrolling the display screen at a speed V and a direction theta; if not, the scrolling speed or direction is adjusted and the scrolling time is recalculated until the condition is met.
How this feature is technically implemented in one embodiment: assuming that a mobile application program is provided, a user can conduct screen sliding operation on a mobile phone screen through gestures to browse different exhibits. When a user selects a target exhibit, the application may use digital twinning techniques to obtain the distance D between the current location and the target exhibit display area. Then, the scroll speed V and the direction θ are set according to preset parameters. The minimum time T required to scroll to the target exhibit is calculated using the formula t=d/V. If T is less than the preset time threshold T0, the application scrolls the screen at a speed V and in a direction θ such that the display area of the target exhibit appears on the screen. If T is greater than T0, the application adjusts the scroll speed or direction and recalculates the scroll time until the condition is met. In this way, users can quickly and accurately browse to the exhibits of interest to them through simple gesture operations.
In one particular embodiment, a mobile slide control method based on digital twinning technology of the present disclosure. The method decides how to display the screen content by judging whether the time spent for the sliding operation is less than a preset time threshold t 0. If the sliding time is less than t0, scrolling the display screen according to the speed V and the direction theta; if the sliding time is greater than t0, the scrolling speed or direction needs to be adjusted and the scrolling time recalculated until the condition is met.
In one embodiment, assume that a user has performed a quick left-right swipe operation on a mobile device. The system first records the time interval T from the start of touching the screen to the end of touching by the user, and compares the time interval T with a preset time threshold T0. If T is smaller than T0, the system performs corresponding left-right scrolling to display the screen content according to the current speed V and the direction theta. However, if T is greater than T0, the system will increase the scroll speed V and recalculate the new time interval T in hopes of being able to complete the presentation faster. If the newly calculated T is still greater than T0, the system will change the scrolling direction θ and recalculate the new time interval T again. This process will repeat until a satisfactory (i.e., T.ltoreq.t0) result is obtained, after which the system will scroll through the presentation screen content using the final determined speed V and direction θ.
In this way, the user can control the scrolling operation on the mobile device according to the sliding speed and time of the user, so that the user can browse and view the screen content more flexibly. Meanwhile, the system can be correspondingly adjusted according to the operation habit and the requirement of the user, so that better use experience is provided.
In one particular embodiment, a mobile slide control method based on digital twinning technology of the present disclosure includes one step. When the included angle between the connecting line of the current position and the display area of the target exhibit and the current rolling direction is smaller than 90 degrees, the rolling direction needs to be adjusted.
In one embodiment, assume that a user is browsing a virtual museum exhibition using a mobile device. The user can browse different exhibits by sliding the finger on the screen. In this particular step, the system determines whether the scrolling direction needs to be adjusted based on the angle between the current location of the user and the line of the display area of the target exhibit and the current scrolling direction.
In one embodiment, if the user wants to slide the target exhibit farther from the right to nearer to the left, a right slide may be selected at the beginning. However, at some point, the current position and target exhibit line are less than 90 degrees from the originally selected right-hand roll direction due to a small angular offset caused by the movement of the user's finger on the screen or other factors.
According to the method of this feature, the system automatically generates in this case an adjusted new scrolling direction and recalculates the time required to accommodate the new direction. For example, in this case, the system may automatically generate a left-hand adjusted scrolling direction and calculate the adjusted scrolling time based on the new direction.
By the mode, the mobile screen sliding control method based on the digital twin technology can be more intelligently adapted to user operation, and smoother and accurate screen sliding experience is provided.
In one particular embodiment, a mobile slide control method based on digital twinning technology of the present disclosure includes one step. And according to the adjusted scrolling direction, recalculating the scrolling time T to realize more accurate screen sliding operation.
In one embodiment, assume that a user performs a swipe operation on a mobile device with the goal of scrolling content on a presentation screen to the left. First, the system calculates the angle β of the line between the current position and the target exhibit display area. Then, calculating the adjusted rolling time T 'according to the formula T' =t (1- β/90); .
If the calculated T' is smaller than the preset time threshold T0, the system performs scrolling operation of the display screen according to the adjusted scrolling direction. In one embodiment, in this example, if T' is calculated to be 5 seconds and the preset time threshold T0 is 1 second, the system will continue the scroll left in the adjusted direction.
If the calculated T' is greater than or equal to the preset time threshold T0, the system needs to adjust the scrolling direction again to achieve more accurate control of the display screen movement effect. This process will be repeated until the appropriate parameters are found such that T' is less than T0.
From the above description, the feature utilizes a digital twin technology to combine the method of included angle calculation and rolling time adjustment, so that the accuracy and flexibility of mobile sliding screen control are realized.
In addition, the invention also provides a mobile sliding screen control system for digital twin technology, which comprises:
the digital twin model building module is used for building a digital twin model of a digital product;
The mapping module maps the digital twin model to the display screen according to a preset rule;
The updating module is used for detecting the sliding operation of a user and updating the position of the digital twin model on the display screen according to the sliding direction and the distance;
And the adjusting module is used for automatically adjusting the content of the display screen according to the position change of the digital twin model, so that a user can quickly see the information of the target exhibit.
The specific contents of a mobile sliding screen control system of the digital-based twinning technology of the present invention have been described with reference to fig. 1 to 6, and will not be described herein.
The disclosed embodiments also provide a computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor/processing core, implements the above-described digital twinning technology based mobile slide screen control. The computer readable storage medium may be a volatile or nonvolatile computer readable storage medium.
Embodiments of the present disclosure also provide a computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when executed in a processor of an electronic device, performs the above-described mobile slide control method based on digital twinning technology.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, functional modules/units in the apparatus, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer-readable storage media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the disclosure are intended to be covered by the protection scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (7)
1. The mobile sliding screen control method based on the digital twin technology is characterized by comprising the following steps of:
establishing a digital twin model of the digital product;
Mapping the digital twin model to a display screen according to a preset rule;
Detecting sliding operation of a user, and updating the position of the digital twin model on the display screen according to the sliding direction and the distance;
according to the position change of the digital twin model, the content of the display screen is automatically adjusted, so that a user can quickly see the information of the target exhibit; wherein the method comprises the steps of
According to the position change of the digital twin model, the content of the display screen is automatically adjusted, so that a user can quickly see the information of the target exhibit, and the method specifically comprises the following steps:
acquiring the current position of the digital twin model on a display screen;
judging whether the current position is in the display area of the target exhibit or not;
if yes, directly displaying the information of the target exhibit;
If not, calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and in a preset direction until the display area of the target exhibit appears on the screen; wherein the method comprises the steps of
The method comprises the steps of calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and in a preset direction until the display area of the target exhibit appears on the screen, and specifically comprises the following steps:
Calculating a linear distance D between the current position and a display area of the target exhibit;
Determining a scrolling speed V and a scrolling direction theta of a display screen;
according to the formula: t=d/V, calculating the minimum time T required to scroll to the display area of the target exhibit;
judging whether T is smaller than a preset time threshold T0 or not; if yes, scrolling the display screen at the speed V and the direction theta;
If not, the rolling speed or direction is adjusted, and the rolling time is recalculated until the condition is met; and wherein
The judgment of whether T is smaller than a preset time threshold T0 is carried out; if yes, scrolling the display screen at the speed V and the direction theta; if not, the rolling speed or direction is adjusted, and the rolling time is recalculated until the condition is met, and the method specifically comprises the following steps:
if T > T0, increasing the scrolling speed V and recalculating the scrolling time T;
If T is still greater than T0, changing the rolling direction theta and recalculating the rolling time T;
Repeating the above steps until T < = T0, and then scrolling the display screen at a speed V and a direction θ.
2. The mobile sliding screen control method based on digital twin technology according to claim 1, wherein the detecting the sliding operation of the user and updating the position of the digital twin model on the display screen according to the sliding direction and the distance comprises the following steps:
a) Detecting a sliding operation of a user on the display screen through a touch sensor;
b) Calculating the sliding direction and the sliding distance of the user;
c) Judging whether the sliding direction accords with a preset rule, and if not, returning to the step a; otherwise, executing the step d;
d) And updating the position of the digital twin model on the display screen according to the calculated sliding direction and distance.
3. The method for controlling a mobile sliding screen based on digital twin technique according to claim 2, wherein updating the position of the digital twin model on the display screen according to the calculated sliding direction and distance comprises the steps of:
e) Calculating the position coordinates of the current digital twin model;
f) C, judging whether the current position coordinates exceed the range of the display screen, and if so, returning to the step c; otherwise, executing the step g;
g) Calculating a target position coordinate;
h) The digital twin model is smoothly transitioned from the current position to the target position.
4. A mobile sliding screen control method based on digital twinning technique according to claim 3, wherein said smoothly transitioning the digital twinning model from the current position to the target position comprises the steps of:
i) Calculating the distance between the current position and the target position;
j) Setting a smooth transition time period;
k) In each time period, calculating the moving distance in the next time period according to the distance between the current position and the target position and the remaining time;
l) updating the position coordinates of the digital twin model.
5. The method for controlling a mobile sliding screen based on digital twin technology as defined in claim 4, wherein the updating the position coordinates of the digital twin model comprises the steps of:
m) if the distance between the new position coordinate of the digital twin model and the target position coordinate is smaller than the set threshold value, setting the position coordinate of the digital twin model as the target position coordinate, and finishing smooth transition; otherwise, continuing to execute the step k.
6. A mobile sliding screen control system based on digital twinning technology, which is characterized by comprising:
the digital twin model building module is used for building a digital twin model of a digital product;
The mapping module maps the digital twin model to the display screen according to a preset rule;
The updating module is used for detecting the sliding operation of a user and updating the position of the digital twin model on the display screen according to the sliding direction and the distance;
The adjusting module automatically adjusts the content of the display screen according to the position change of the digital twin model, so that a user can quickly view the information of the target exhibit; wherein the method comprises the steps of
According to the position change of the digital twin model, the content of the display screen is automatically adjusted, so that a user can quickly see the information of the target exhibit, and the method specifically comprises the following steps:
acquiring the current position of the digital twin model on a display screen;
judging whether the current position is in the display area of the target exhibit or not;
if yes, directly displaying the information of the target exhibit;
If not, calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and in a preset direction until the display area of the target exhibit appears on the screen; wherein the method comprises the steps of
The method comprises the steps of calculating the distance between the current position and the display area of the target exhibit, and scrolling the display screen at a preset speed and in a preset direction until the display area of the target exhibit appears on the screen, and specifically comprises the following steps:
Calculating a linear distance D between the current position and a display area of the target exhibit;
Determining a scrolling speed V and a scrolling direction theta of a display screen;
according to the formula: t=d/V, calculating the minimum time T required to scroll to the display area of the target exhibit;
judging whether T is smaller than a preset time threshold T0 or not; if yes, scrolling the display screen at the speed V and the direction theta;
If not, the rolling speed or direction is adjusted, and the rolling time is recalculated until the condition is met; and wherein
The judgment of whether T is smaller than a preset time threshold T0 is carried out; if yes, scrolling the display screen at the speed V and the direction theta; if not, the rolling speed or direction is adjusted, and the rolling time is recalculated until the condition is met, and the method specifically comprises the following steps:
if T > T0, increasing the scrolling speed V and recalculating the scrolling time T;
If T is still greater than T0, changing the rolling direction theta and recalculating the rolling time T;
Repeating the above steps until T < = T0, and then scrolling the display screen at a speed V and a direction θ.
7. A computer readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the method according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311792690.4A CN117908722B (en) | 2023-12-25 | 2023-12-25 | Mobile sliding screen control method, system and medium based on digital twin technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311792690.4A CN117908722B (en) | 2023-12-25 | 2023-12-25 | Mobile sliding screen control method, system and medium based on digital twin technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117908722A CN117908722A (en) | 2024-04-19 |
| CN117908722B true CN117908722B (en) | 2024-06-25 |
Family
ID=90690130
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311792690.4A Active CN117908722B (en) | 2023-12-25 | 2023-12-25 | Mobile sliding screen control method, system and medium based on digital twin technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117908722B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794979A (en) * | 2022-11-30 | 2023-03-14 | 大连理工大学 | GIS digital twinning system based on Unity3D |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11935288B2 (en) * | 2019-12-01 | 2024-03-19 | Pointivo Inc. | Systems and methods for generating of 3D information on a user display from processing of sensor data for objects, components or features of interest in a scene and user navigation thereon |
| CN116964638A (en) * | 2021-02-17 | 2023-10-27 | 新加坡国立大学 | Method involving virtual reality systems and interactive objects |
-
2023
- 2023-12-25 CN CN202311792690.4A patent/CN117908722B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115794979A (en) * | 2022-11-30 | 2023-03-14 | 大连理工大学 | GIS digital twinning system based on Unity3D |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117908722A (en) | 2024-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11557102B2 (en) | Methods for manipulating objects in an environment | |
| US20220084279A1 (en) | Methods for manipulating objects in an environment | |
| CN107469354B (en) | Visible sensation method and device, storage medium, the electronic equipment of compensating sound information | |
| KR101823182B1 (en) | Three dimensional user interface effects on a display by using properties of motion | |
| EP2796973B1 (en) | Method and apparatus for generating a three-dimensional user interface | |
| US10359906B2 (en) | Haptic interface for population of a three-dimensional virtual environment | |
| CN107204044B (en) | Picture display method based on virtual reality and related equipment | |
| CN105637559A (en) | Structural modeling using depth sensors | |
| US11720171B2 (en) | Methods for navigating user interfaces | |
| CN115134649B (en) | Method and system for presenting interactive elements within video content | |
| CN106873886B (en) | Control method and device for stereoscopic display and electronic equipment | |
| CN109731329B (en) | Method and device for determining placement position of virtual component in game | |
| KR20150132527A (en) | Segmentation of content delivery | |
| WO2022166448A1 (en) | Devices, methods, systems, and media for selecting virtual objects for extended reality interaction | |
| CN111061421B (en) | Picture projection method and device and computer storage medium | |
| WO2017116815A1 (en) | Hand tracking for user interface operation at-a-distance | |
| CN109407824A (en) | Manikin moves synchronously method and apparatus | |
| KR101338958B1 (en) | system and method for moving virtual object tridimentionally in multi touchable terminal | |
| CN117908722B (en) | Mobile sliding screen control method, system and medium based on digital twin technology | |
| JP2014085816A (en) | Program, information processing device, information processing method, and information processing system | |
| CN108700992B (en) | Information processing apparatus, information processing method, and computer readable medium | |
| JP5767371B1 (en) | Game program for controlling display of objects placed on a virtual space plane | |
| CN113243000A (en) | Capture range for augmented reality objects | |
| US9483878B2 (en) | Contextual editing using variable offset surfaces | |
| KR101743888B1 (en) | User Terminal and Computer Implemented Method for Synchronizing Camera Movement Path and Camera Movement Timing Using Touch User Interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |