CN108234986B - For treating the 3D rendering management method and management system and device of myopia or amblyopia - Google Patents
For treating the 3D rendering management method and management system and device of myopia or amblyopia Download PDFInfo
- Publication number
- CN108234986B CN108234986B CN201810054258.8A CN201810054258A CN108234986B CN 108234986 B CN108234986 B CN 108234986B CN 201810054258 A CN201810054258 A CN 201810054258A CN 108234986 B CN108234986 B CN 108234986B
- Authority
- CN
- China
- Prior art keywords
- image
- rendering
- parameter
- amblyopia
- eyes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention provides it is a kind of for treat myopia or amblyopia 3D rendering management method, first by 2D image be converted into can dynamic change 3D rendering;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body, and wherein left eye can only see left view difference image, and right eye can only see right anaglyph;In terminal plays, the parameter of left view difference image and right anaglyph can individually be adjusted the 3D rendering according to the needs of users, and the parameter regulation of one of image does not influence the parameter of another image.Terminal processing method of the invention makes the system for the treatment of myopia or amblyopia no longer need to remake special video;It is designed to that the parameter of all or part of picture of left and right screen is individually adjusted; have no effect on the parameter of another picture; space, more efficient treatment amblyopia eye can be more fully selected to doctor, while the eyes of another health being protected sufficiently to be taken exercise and protected.
Description
Technical field
The invention belongs to digital processings and medical field, are related to a kind of for treating the 3D rendering manager of myopia or amblyopia
Method and management system and device.
Background technique
VR (Virtual Reality, virtual reality) technology can show virtual scene by equipment before user,
Including vision, the sense of hearing, interaction etc. etc..Wherein vision is to currently form the most important factor of virtual sense organ, existing VR equipment
Using human body binocular stereo vision, the different images for seeing two eyes of user, to just generate three-dimensional sense by parallax
3D scene.This characteristic can be used for the various fields including medical application.
Currently, the content Forming Mechanism of VR equipment is complicated, lazy weight is presented in the content for causing VR equipment that can show, can not
The problems such as customization.
The existing method for forming VR equipment vision content is as follows:
By manually modeling or edit 3D scene, then 3D image recording is carried out, it is specific virtual existing to be provided for VR equipment
Real content.First pass through artificial 3D modeling, recycle computer graphics calculate to be formed fixed parallax double screen content it is direct
It is supplied to VR equipment.The method, the cost of labor for constructing scene is very high, and the scale of content quantity is caused not expanded effectively
Exhibition.On the other hand, since the virtual scene of formation is recorded in advance, the virtual scene can not being customized change and more
Newly.
By introducing 2D multimedia resource (image and video), 2D resource and artificial constructed 3D scene are combined,
It recycles and calculates to achieve the purpose that 2D media can be shown under fixed 3D virtual scene.2D resource is fixed on specific 3D
Under virtual scene, reaches 2D resource and be present in the pseudo- 3D visual effect in 3D virtual scene, formed by computer disparity computation
Family can be used to adjust different visual angle viewing 2D resource contents for double screen content.This method can be effectively more by existing a large amount of 2D
Media resource forms virtual scene content, but position of the 2D resource under 3D scene be fixation can not dynamic regulation, cannot
Change 2D resource content dynamically in 3D scene.As a result, content show be also can not being customized change, thus very greatly
Degree loses the characteristic that can configure, can be interacted of VR content.
Although and there is 2D resource to be converted into 3D resource in the prior art now, be the absence of 3D rendering required for treating
Mapping function, such as translation, overturning, the scaling of image etc., therefore can not be well using existing in the treatment of myopia or amblyopia
The 2D resource of some other fields.
Amblyopia is the common eye diseases in children of clinical ophthalmology, is infant period, due to various reasons such as consciousness, movement, biography
It leads and the reasons such as visual center fails to receive suitable view stimulation, so that visual development is affected and the visual performance decline that occurs
State is mainly shown as low vision and binocular vision obstacle.
Treating the common treatment method of amblyopia is covering method, is divided into complete and part overlaid.Purpose is to cover strong eye,
It forces amblyopia eye fixation and carries out fine work.However covering method frequently can lead to the healthy eyes of amblyopia opposite side due to for a long time
Covering amblyopia occurs and influences the stereopsis and fusion function of eyes.
Conventional images processing method is the processing carried out for single image, does not have and is directed to eyes feature for same image
Processing is the different degrees of function of showing content, it is thus impossible to be applied under the different VR application scenarios of eyes physiological parameter.
On the other hand, traditional images processing method does not have the characteristics of continuously adjusting image processing effect of parametrization, because
This does not adapt to the different fine-tuning capabilities under the conditions of eye, to cannot be efficiently applied to use eye medical field.
Summary of the invention
The object of the present invention is to provide being 3D entity in 3D scene by 2D resource conversion, and by computer graphics
3D conversion is allowed to can dynamically change (including displacement, rotation, scaling) in position in 3D scene, and using dichoptic viewing
Three-dimensional imaging mode is made, at the same eyes depending on image parameter individually adjust, with reach be directed to patient individual instances
Effectively treatment amblyopia, protects the purpose of eyes.
To achieve the above object, the present invention takes following technical proposals to realize:
For treating the management method of the 3D rendering of myopia or amblyopia, comprising: converting 2D image to can dynamically become first
The 3D rendering of change;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body, wherein
Left eye can only see left view difference image, and right eye can only see right anaglyph;
The 3D rendering in terminal plays, according to the needs of users may be used by the parameter of left view difference image and right anaglyph
To be individually adjusted, the parameter regulation of one of image does not influence the parameter of another image;
Wherein 2D image be converted into can dynamic change 3D rendering method are as follows: to 2D image carry out image contract, will take out
It takes result to be placed in 3D coordinate system by texture mapping operation, motion process is then carried out in 3D coordinate system and rendering is realized and moved
State variation, first progress 3D coordinate conversion, which calculates to be formed by projection calculating again, carries out 2D image projection;By calculating parallax in real time,
The multimedia content of 2D image is incorporated into 3D scene by way of movable plane, makes it can be in 3D virtual scene according to pre-
Determine the dynamic change that mode carries out 3D rendering.
Further, the dynamic change of 3D rendering is one of translation, rotation, overturning or scaling of image or a variety of.
Further, the 2D image be converted into can dynamic change 3D rendering method the following steps are included:
Step a carries out image contract to 2D image;
Step b chooses required 3D virtual scene;
Step c constructs 2D the resource plane in 3D virtual scene, and constructs the first of place coordinate system for its 2D the resource plane
Beginning position, angle and size;
Step d constructs the intrinsic coordinates system of 2D the resource plane, by parsing the feature of 2D resource image, carries out coordinate and reflects
Calculating is penetrated, converts 2D resource image to the textures of 2D the resource plane;
2D multimedia content is incorporated 3D scene by calculating parallax in real time by step e by way of movable plane,
It is allowed to that configurable 3D figure conversion can be carried out.
Further, in step e, 2D resource entity is converted in 3D scene by configurable variation pattern, is counted
Calculation process is as follows:
Obtain plane initial coordinate matrix and current coordinate conversion conversion coordinates matrix;
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;
The coordinate that the resource plane is carried out under 3D scene calculates, to obtain the coordinate of the resource plane under next frame, and again
Calculate the reflecting effect of light;
Current eyes are calculated in virtual scene by the motion sensor data of VR equipment and the configuration data of equipment
Position and visual angle;
It is calculated under next frame including 2D content by the resource plane position of next frame and the virtual location of eyes
The projection relation of all objects under 3D scene forms the double screen with parallax effect.
Further, the parameter of the left view difference image and right anaglyph be left view difference image and right anaglyph all or
The size of part picture, brightness, gray scale, saturation degree, one of contrast or a variety of.
Further, the parameter of the left view difference image and right anaglyph part picture immobilizes, and when adjusting only changes
The parameter of setting section.
Further, the method for independent adjustment parameter is that configurable content shelter is carried out according to right and left eyes parameter setting
Reason, comprising the following steps:
The screen of VR equipment eyes is obtained, and is translated into image
Content is subjected to left and right split screen, and configurable content masking is carried out according to right and left eyes parameter and is handled.
For right and left eyes parameter configuration, color, light and shade, the independent process of contrast can be carried out to right and left eyes image.
For right and left eyes parameter configuration, the independent process of image size can be carried out to right and left eyes image.
Export right and left eyes image.
Further, the step of configurable content masking processing being carried out according to right and left eyes parameter are as follows:
Step 1, the content that copies picture is two parts of right and left eyes;
Step 2, right and left eyes parameter is mapped to masking percentage P1, the P2 of the two parts of contents in left and right, wherein eyes cover
The sum of content P1+P2 < 100%;
Step 3, picture pixels summation X is obtained, the unit-sized of mosaic is calculated according to configuration, m*n pixel square is one
A fundamental unit;
Step 4, Y fundamental unit is selected at random as mosaic square, makes the total pixel Y*m*n=X* (P1+ of mosaic
P2);
Step 5, the image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value.
The present invention also provides a kind of for treating the 3D rendering management system of myopia or amblyopia, including image extraction module,
Computing module, 3D processing module, parameter adjustment module and VR equipment;Wherein image extraction module carries out image pumping to 2D image
It takes, computing module first carries out the conversion of 3D coordinate and calculates, by calculating parallax in real time, using 3D processing module by more matchmakers of 2D image
Hold in vivo and incorporate 3D scene by way of movable plane, make its can in the 3D virtual scene of VR equipment according to predetermined way into
The dynamic change of row 3D rendering;Parameter adjustment module is by carrying out configurable content shelter according to right and left eyes parameter setting
Reason realizes the independent adjusting of the parameter of left view difference image and right anaglyph.
The present invention also provides a kind of device for treating amblyopia, described device includes wearable device, is equipped in the equipment
The above-mentioned 3D rendering management system for being used to treat myopia or amblyopia.
Compared with prior art, the invention has the following advantages that
2D multimedia content is incorporated 3D scene by the present invention by way of movable plane, to realize that quick VR content produces
It is raw;
By using the real-time method for calculating parallax, 2D multimedia content is incorporated 3D by way of movable plane
Scape is allowed to that configurable 3D graphics conversion can be carried out, i.e., multimedia content can carry out in virtual scene according to predetermined way
Translation, rotation, overturning, scaling etc. change;
The calculation method for carrying out 2D projection again by first carrying out the conversion calculating of 3D coordinate, under the support of equipment computing capability
The dynamic optical oomputing that can carry out virtual scene can make the movement of 2D multimedia content more true under virtual scene.
3D rendering of the invention parameter adjusting method of the invention is designed to left and right screen according to the own characteristic of amblyopia patient
Size, brightness, gray scale, color saturation and contrast of all or part of picture of curtain etc. are individually adjusted, and are had no effect on another
The parameter of a picture can more fully select space to doctor, the case where for individual patients, more efficient treatment amblyopia
Eye, while the eyes of another health being protected sufficiently to be taken exercise and protected.
Specifically, the present invention can independently carry out the processing of content for binocular vision, using a variety of crippled modes in conjunction with next
Form the medical procedure of customizable;Various reduction processes, which are realized, all can carry out continuously linear adjustment by eyes parameter, can press
Medical progress is finely adjusted adaptation.
By watching 3D rendering of the invention, can take exercise children with amblyopia it is fixed as, position, identify, following, searching etc. it is related
Aspect technical ability.Under the support of body-sensing interaction technique, making children with amblyopia association inspection operation by training, (movement, eye, brain are assisted
Adjust), visual skill is grasped, eye impressions are established, forms visual memory, cerebral cortex optic element is promoted and influence is processed
Journey, to promote the raising of their vision operational capability.
Specific embodiment
The present invention will be described in detail combined with specific embodiments below.
In one embodiment of the invention, common 2D resource is converted into 3D resource, the specific steps are as follows:
Image contract is carried out to 2D resource (especially video) in VR software systems;
VR software systems, which import, chooses 3D virtual scene;2D the resource plane is constructed in 3D virtual scene, and (size is suitable
In plane), and be its building where coordinate system initial position, angle and size;
The intrinsic coordinates system for constructing 2D the resource plane carries out coordinate mapping calculation by the feature of parsing 2D resource image,
Convert 2D resource image to the textures of 2D the resource plane;
2D resource entity can be converted in 3D scene by configurable variation pattern, and calculating process is as follows:
Obtain plane initial coordinate matrix and current conversion coordinates matrix;
Plane initial coordinate be the time started be 0 when coordinate;
Calculate the transition matrix in each stage;
Transition matrix is from time point 0 (at the beginning of definition) to displacement, the rotation in current point in time this period
The summation of equal operations, the coordinate of initial coordinate * transition matrix=current.
With regard in one embodiment of the invention if video has 100 frames, that if each frame carry out a location updating if,
99 location updatings are just had, also just there are 99 transition matrixes.
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;
For example, being at the uniform velocity moved to bottom right from upper left " such it is intended to become 99 transition matrixes (each to indicate to move to right
Little by little, a little is moved down).
Obtaining configured plane motion track is exactly to pass through software configuration, can predefined movement effects, such as
From left to right, while at random above and below, while the rotation etc. accelerated, motion profile herein refers to the effect that user intentionally gets
Fruit.
The coordinate that the resource plane is carried out under 3D scene calculates, and (is related to putting down to obtain the coordinate of the resource plane under next frame
Move, rotate and scale), and recalculate the reflecting effect of light;
This step be exactly by " changing coordinates " * " next stage transition matrix ", the result is that next frame it should coordinate, so
The calculating of light is carried out further according to new coordinate afterwards.By the relative position of current plane and light source and angle processing such as point light source or
Reflecting effect under source of parallel light.
Current eyes are calculated by the motion sensor data of VR equipment and the configuration data (interpupillary distance etc.) of distinct device
Position and visual angle in virtual scene;
The exercise data that the motion sensor of VR equipment obtains, the main angle for indicating user's rotary head, the angle etc. of new line
Deng.It is input with user perspective, considers interpupillary distance, coordinate and direction of the right and left eyes in 3D scene is calculated, by by 3D
The projection that scape carries out right and left eyes calculates to form final image.
It is calculated under next frame including 2D content by the resource plane position of next frame and the virtual location of eyes
The projection relation of all objects under 3D scene forms the double screen with parallax effect.
The present invention specifically provides a kind of device for treating amblyopia, and described device includes wearable device, 3D in the equipment
Picture system includes display screen, convex lens eyeglass and output left view difference image on a display screen and right anaglyph;It is wherein left
Anaglyph and right anaglyph are divided equally on a display screen, and left view difference image and right anaglyph are distributed at axial symmetry;The left side
The parameter of anaglyph and right anaglyph is individually adjusted according to the needs of users.
Wherein the headset equipment is worn on user's head, is respectively equipped with lens or lens in corresponding human body eyes position
Group.
Display can be the general display that headset equipment corresponding position is arranged in for playing 3D rendering,
It can be common smart mobile phone screen, or retinal projection's formula display.
By taking common smart mobile phone common at present as an example, one accommodating chamber is set in headset equipment corresponding position, it will
Mobile phone is put into, and mobile phone display screen is directed at the lens or lens group position of headset equipment.Preset 3D rendering can be stored in mobile phone
In, click play.
The left view difference image and right anaglyph are made respectively according to human body binocular parallax principle, and the two has micro-
The image of small difference, left view difference image and right anaglyph are distributed at axial symmetry, and a wherein width picture is respectively seen in human body eyes,
Then fusion obtains the image that a width has stereoscopic effect.By the way that same picture is divided into left view difference image and right anaglyph,
Allow to simulate remote target with close-target, makes our eyes that can obtain seeing remote in near-ambient encirclement and see close coordination
It takes exercise.
3D rendering in the present invention is bisected into left view difference image and right anaglyph among picture.It is with smart phone
Example, smart phone screen is laterally disposed, it then is bisected into left screen and right screen from centre, plays left view difference image and right view respectively
Difference image.
The left and right eyepiece of convex lens glasses is convex lens, and left and right eyepiece center respectively corresponds two screens in left and right.
Left and right screen can adjust related software parameters, the software by the various control modes such as touch screen, key or knob
Information and the size to all or part of picture of left and right screen, brightness, gray scale, color are obtained according to the sensor of system support
Saturation degree and contrast etc. make corresponding adjustment, and the image between left and right screen after the adjustment can be right by 3D rendering system
Amblyopia patient carries out treatment training.
Left view difference image of the invention and right anaglyph can individually be adjusted parameter.One embodiment of the invention
In, 3D rendering is played such as the software on mobile phone by terminal device, which can adequately select simultaneously to client
The individually parameters of selection left view difference image and right anaglyph.Or it is controlled to adjust with bluetooth approach connection remote control device etc.
Parameters.
For example, the parameter of right anaglyph is able to maintain when the parameter of left view difference image is adjusted to maximum value from minimum value
The parameter of original image does not change.Or when the area parameters of left view difference image are from the maximum value of raw frames 100%, press
When being adjusted to 70% minimum big value in proportion, the original size that the area parameters of right anaglyph are able to maintain original image is not sent out
Changing.
In one embodiment of the invention, processing method of the invention is to be carried out in configurable according to right and left eyes parameter setting
Hold masking processing, comprising the following steps:
The content that copies picture is two parts of right and left eyes;
Right and left eyes parameter is mapped to masking percentage P1, P2 (the sum of content of eyes masking P1+ of the two parts of contents in left and right
P2 < 100%);
Picture pixels summation X is obtained, (m*n pixel square is a basis according to the unit-sized of configuration calculating mosaic
Unit);
Y fundamental unit is selected as mosaic square at random, makes the total pixel Y*m*n=X* (P1+P2) of mosaic;
The image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value;
For square content, the mode in step 3 can be used to carry out Weakening treatment.
Specifically, being directed to right and left eyes parameter configuration, independent process can be carried out to right and left eyes image.Wherein each seed ginseng of image
Number regulating step can be carried out freely in any order, and the adjusting of each parameter is independent of each other each other, and be not necessarily to restriction sequence.This hair
It is bright that several specific embodiments are as follows, how can be adjusted for different parameters illustration.
The independent adjusting of 1 color of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. (existing above there are many expression method of pixel color, calculating below for each pixel numerical value of acquisition image
It is illustrated at method with RGB statement)
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the colouring intensity of image is adjusted, forms the received image color intensity of right and left eyes
Difference.Its detailed process be by image carry out pixel scale calculating so that image showed according to different parameters it is different
Color effect, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that there is image original color to present when P is 1, when P is 0, image is rendered as gray level image, P
When changing for median, the effect variation of image changes linearly relationship
This method carries out the color Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image
Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar).
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above
For the pixel processing method of specific image ashing there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->(R*P+(R+G+B)/3*(1-P),G*P+(R+G+B)/3*(1-P),B*P+(R+G+B)/3*(1-
P))。
According to right and left eyes configuration parameter, the light and shade intensity of image is adjusted, forms the received image light and shade intensity of right and left eyes
Difference.Its detailed process be by image carry out pixel scale calculating so that image showed according to different parameters it is different
Brightness effects, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that there is image original color to present when P is 1, when P is 0, image is rendered as pure black image, P
When changing for median, the effect variation of image changes linearly relationship
This method carries out the color Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image
Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar);
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above
For the pixel processing method that specific image darkens there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->(R*P,G*P,B*P)。
The independent adjusting of 2 contrast of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. obtaining each pixel numerical value of image
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the contrast intensity of image is adjusted, makes the received image light and shade intensity shape of right and left eyes
At difference.Its detailed process is by carrying out pixel scale calculating to image, so that image shows difference according to different parameters
Brightness effects, the method is as follows:
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that redistributing the colour gamut of image using P value, the color contrast of the bigger image of P value is more obvious, P value
Difference is corresponding between the color gamut and pixel of smaller image reduces.When P is 1, there is image original color to present, and work as P
When being 0, image is rendered as gray image, and when P is that median changes, the effect variation of image changes linearly relationship
This method carries out the comparison Weakening treatment of image using the mapping mode of pixel scale, empty with the RGB color of image
Between be described for model, (other models such as HSV etc., expression method is different, but its mathematical computations essence is similar)
Its rgb value is obtained for each pixel of image, and is replaced with the mapping value of response, meets features above
For the pixel processing method of specific image comparison reduction there are many calculation, typical mapping method example is following (but not containing only):
(R,G,B)->((R+Max*(1-P))/2,(G+Max*(1-P))/2,(B+Max*(1-P))/2)
Wherein Max value is the maximum value upper limit of RGB, can be considered 1 after normalization.
The independent adjusting of 3 image size of embodiment
Specific step is as follows:
1. obtaining eye parameters
2. obtaining each pixel numerical value of image
3. the numerical value of pair each pixel calculates, specific as follows:
According to right and left eyes configuration parameter, the size of image is adjusted, the received image size of right and left eyes is made to form difference.
Input the information strength parameter percentage P ([0,1] range) that parameter is the left and right two
It is characterized in that the bigger image area of P value is bigger, the smaller image area of P value is smaller.When P is 1, image has original
Size present, when P be 0 when, image area 0, P be median change when, image effect variation changes linearly relationship.
This method is calculated using the scaling that interpolation method carries out image, and process is as follows:
The size (long and wide) of picture after scaling is recalculated by ratio;
Calculate respective coordinates of each pixel in the picture of source in Target Photo;
It is carried out according to pixel coordinate, the interpolation calculation (such as neighbor interpolation, two-wire interpolation etc.) of Target Photo pixel color;
Export target image.
Although the invention has been described by way of example and in terms of the preferred embodiments, but it is not for limiting the present invention, any this field
Technical staff without departing from the spirit and scope of the present invention, may be by the masking device and technology contents pair of the disclosure above
Technical solution of the present invention makes possible variation and modification, therefore, anything that does not depart from the technical scheme of the invention, according to this
The technical spirit of invention any simple modifications, equivalents, and modifications made to the above embodiment, belong to the technology of the present invention
The protection scope of scheme.
Claims (10)
1. the management method for the 3D rendering for treating myopia or amblyopia, which is characterized in that first convert 2D image to movably
The 3D rendering of state variation;Then 3D rendering includes left view difference image and right anaglyph, respectively corresponds the left eye and right eye of human body,
Wherein left eye can only see left view difference image, and right eye can only see right anaglyph;
For the 3D rendering in terminal plays, the parameter of left view difference image and right anaglyph according to the needs of users can be single
It is solely adjusted, the parameter regulation of one of image does not influence the parameter of another image;
Wherein 2D image be converted into can dynamic change 3D rendering method are as follows: to 2D image carry out image contract, by extract tie
Fruit is placed in 3D coordinate system by texture mapping operation, and motion process is then carried out in 3D coordinate system and rendering realizes that dynamic becomes
Change, first progress 3D coordinate conversion, which calculates to be formed by projection calculating again, carries out 2D image projection;By calculating parallax in real time, by 2D
The multimedia content of image incorporates 3D scene by way of movable plane, makes it can be in 3D virtual scene according to predetermined party
The dynamic change of formula progress 3D rendering.
2. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that 3D figure
The dynamic change of picture is one of translation, rotation, overturning or scaling of image or a variety of.
3. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described
2D image be converted into can dynamic change 3D rendering method the following steps are included: step a, image contract is carried out to 2D image;
Step b chooses required 3D virtual scene;
Step c constructs 2D the resource plane in 3D virtual scene, and the initial bit of place coordinate system is constructed for its 2D the resource plane
It sets, angle and size;
Step d constructs the intrinsic coordinates system of 2D the resource plane, by parsing the feature of 2D resource image, carries out coordinate mapping meter
It calculates, converts 2D resource image to the textures of 2D the resource plane;
2D multimedia content is incorporated by way of movable plane 3D scene, is allowed to by step e by calculating parallax in real time
It can carry out configurable 3D figure conversion.
4. according to claim 3 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that step
In e, 2D resource entity is converted in 3D scene by configurable variation pattern, and calculating process is as follows:
Obtain plane initial coordinate matrix and current coordinate conversion conversion coordinates matrix;
Configured plane motion track is obtained, and calculates the transition matrix of current generation, and is allowed to smooth;Under 3D scene
The coordinate for carrying out the resource plane calculates, and to obtain the coordinate of the resource plane under next frame, and recalculates the reflecting effect of light;
Position of the current eyes in virtual scene is calculated by the motion sensor data of VR equipment and the configuration data of equipment
It sets and visual angle;
The field 3D under next frame including 2D content is calculated by the resource plane position of next frame and the virtual location of eyes
The projection relation of all objects under scape forms the double screen with parallax effect.
5. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described
The parameter of left view difference image and right anaglyph is the size, bright of left view difference image and right anaglyph all or part picture
Degree, gray scale, saturation degree, one of contrast or a variety of.
6. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that described
The parameter of left view difference image and right anaglyph part picture immobilizes, and when adjusting only changes the parameter of setting section.
7. according to claim 1 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that individually
The method of adjustment parameter is to carry out configurable content masking according to right and left eyes parameter setting to handle, comprising the following steps:
The screen of VR equipment eyes is obtained, and is translated into image;
Content is subjected to left and right split screen, and configurable content masking is carried out according to right and left eyes parameter and is handled;
For right and left eyes parameter configuration, color, light and shade, the independent process of contrast can be carried out for right and left eyes to right and left eyes image
Parameter configuration can carry out the independent process of image size to right and left eyes image;
Export right and left eyes image.
8. according to claim 7 for treating the management method of the 3D rendering of myopia or amblyopia, which is characterized in that according to
Right and left eyes parameter carries out the step of configurable content masking processing are as follows:
Step 1, the content that copies picture is two parts of right and left eyes;
Step 2, right and left eyes parameter is mapped to masking percentage P1, the P2 of the two parts of contents in left and right, wherein the content of eyes masking
The sum of P1+P2 < 100%;
Step 3, picture pixels summation X is obtained, the unit-sized of mosaic is calculated according to configuration, m*n pixel square is a base
Plinth unit;
Step 4, Y fundamental unit is selected at random as mosaic square, makes the total pixel Y*m*n=X* (P1+ of mosaic
P2);
Step 5, the image that masking square will be chosen to be randomly assigned to left and right eyes in proportion according to P1:P2 value.
9. a kind of for treating the 3D rendering management system of myopia or amblyopia, which is characterized in that the 3D rendering management system packet
Include image extraction module, computing module, 3D processing module, parameter adjustment module and VR equipment;Wherein image extraction module is to 2D
Image carries out image contract, and computing module first carries out the conversion of 3D coordinate and calculates, and by calculating parallax in real time, utilizes 3D processing module
The multimedia content of 2D image is incorporated into 3D scene by way of movable plane, it can be in the 3D virtual field of VR equipment
The dynamic change of 3D rendering is carried out in scape according to predetermined way;Parameter adjustment module by according to right and left eyes parameter setting progress can
The content masking of configuration is handled, and realizes the independent adjusting of the parameter of left view difference image and right anaglyph.
10. a kind of device for treating amblyopia, described device include wearable device, it is equipped in the equipment such as claim 9 institute
That states is used to treat the 3D rendering management system of myopia or amblyopia.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810054258.8A CN108234986B (en) | 2018-01-19 | 2018-01-19 | For treating the 3D rendering management method and management system and device of myopia or amblyopia |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810054258.8A CN108234986B (en) | 2018-01-19 | 2018-01-19 | For treating the 3D rendering management method and management system and device of myopia or amblyopia |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108234986A CN108234986A (en) | 2018-06-29 |
CN108234986B true CN108234986B (en) | 2019-03-15 |
Family
ID=62668067
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810054258.8A Active CN108234986B (en) | 2018-01-19 | 2018-01-19 | For treating the 3D rendering management method and management system and device of myopia or amblyopia |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108234986B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111202663B (en) * | 2019-12-31 | 2022-12-27 | 浙江工业大学 | Vision training learning system based on VR technique |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103384340A (en) * | 2013-06-28 | 2013-11-06 | 中南大学 | Method for obtaining 3D imaging image from single 2D image |
WO2014070814A2 (en) * | 2012-11-01 | 2014-05-08 | X6D Limited | Glasses for amblyopia treatment |
CN104618710A (en) * | 2015-01-08 | 2015-05-13 | 左旺孟 | Dysopia correction system based on enhanced light field display |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI468849B (en) * | 2011-04-28 | 2015-01-11 | Inst Information Industry | Building texture extracting apparatus and method thereof |
-
2018
- 2018-01-19 CN CN201810054258.8A patent/CN108234986B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014070814A2 (en) * | 2012-11-01 | 2014-05-08 | X6D Limited | Glasses for amblyopia treatment |
CN103384340A (en) * | 2013-06-28 | 2013-11-06 | 中南大学 | Method for obtaining 3D imaging image from single 2D image |
CN104618710A (en) * | 2015-01-08 | 2015-05-13 | 左旺孟 | Dysopia correction system based on enhanced light field display |
Also Published As
Publication number | Publication date |
---|---|
CN108234986A (en) | 2018-06-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108271011B (en) | For treating the parameter processing method and system and device of the 3D rendering system of amblyopia | |
US7428001B2 (en) | Materials and methods for simulating focal shifts in viewers using large depth of focus displays | |
JP6870080B2 (en) | Image generator, image display system, and image generation method | |
US20200174262A1 (en) | Head-mountable apparatus and methods | |
CN106484116B (en) | The treating method and apparatus of media file | |
CN110121885A (en) | For having recessed video link using the wireless HMD video flowing transmission of VR, the low latency of watching tracking attentively | |
CN107277495A (en) | A kind of intelligent glasses system and its perspective method based on video perspective | |
CN105629469B (en) | Head-mounted display apparatus based on liquid crystal lens array | |
CN106491323B (en) | For treating the video system and device of amblyopia | |
US11962746B2 (en) | Wide-angle stereoscopic vision with cameras having different parameters | |
CN104581119B (en) | A kind of display methods of 3D rendering and a kind of helmet | |
CN107272200A (en) | A kind of focal distance control apparatus, method and VR glasses | |
US11570426B2 (en) | Computer-readable non-transitory storage medium, web server, and calibration method for interpupillary distance | |
CN110021445A (en) | A kind of medical system based on VR model | |
CN107669455A (en) | A kind of vision training method, device and equipment | |
US20200051207A1 (en) | Image generating apparatus, image displaying system, and image generating method | |
WO2007059477A2 (en) | Virtual patient simulator | |
WO2018176927A1 (en) | Binocular rendering method and system for virtual active parallax computation compensation | |
CN109521871B (en) | Training method, device, equipment and storage medium for fusion function | |
CN108064447A (en) | Method for displaying image, intelligent glasses and storage medium | |
CN108234986B (en) | For treating the 3D rendering management method and management system and device of myopia or amblyopia | |
CN102798981B (en) | Biomimetic 3D (three dimensional) stereoimaging system | |
Çöltekin | Foveation for 3D visualization and stereo imaging | |
CN116172493A (en) | Imaging and display method for endoscope system and endoscope system | |
CN107929006A (en) | A kind of vision training method, device and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |