CN111508059A - Crop picking demonstration method, device, system and medium based on 3D model - Google Patents

Crop picking demonstration method, device, system and medium based on 3D model Download PDF

Info

Publication number
CN111508059A
CN111508059A CN202010212188.1A CN202010212188A CN111508059A CN 111508059 A CN111508059 A CN 111508059A CN 202010212188 A CN202010212188 A CN 202010212188A CN 111508059 A CN111508059 A CN 111508059A
Authority
CN
China
Prior art keywords
picking
model
parameters
standard tree
tree model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010212188.1A
Other languages
Chinese (zh)
Other versions
CN111508059B (en
Inventor
江良
赵广
徐凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Tiantian Xuenong Network Technology Co ltd
Original Assignee
Shenzhen Tiantian Xuenong Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Tiantian Xuenong Network Technology Co ltd filed Critical Shenzhen Tiantian Xuenong Network Technology Co ltd
Priority to CN202010212188.1A priority Critical patent/CN111508059B/en
Publication of CN111508059A publication Critical patent/CN111508059A/en
Application granted granted Critical
Publication of CN111508059B publication Critical patent/CN111508059B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01DHARVESTING; MOWING
    • A01D46/00Picking of fruits, vegetables, hops, or the like; Devices for shaking trees or shrubs
    • A01D46/30Robotic devices for individually picking crops
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention belongs to the technical field of crop picking, and relates to a crop picking demonstration method, device and system based on a 3D model. The method comprises the following steps: constructing a 3D virtual sand table system; receiving growth parameters, and generating and displaying a 3D standard tree model according to the growth parameters; receiving a picking stage and picking parameters; judging whether the picking parameters meet the picking parameter standards of the pre-stored 3D standard tree model in the picking stage or not; and if so, displaying the picking snapshot of the 3D standard tree model after picking according to the picking parameters. The invention can improve the intuition and interactivity of the crop picking process.

Description

Crop picking demonstration method, device, system and medium based on 3D model
Technical Field
The invention relates to the technical field of crop picking, in particular to a crop picking demonstration method, a crop picking demonstration device, a crop picking demonstration system and a crop picking demonstration medium based on a 3D model.
Background
At present, technical guidance for picking crops is transmitted and learned in the form of electronic books or information pictures and the like. The electronic book or the information picture is not very intuitive and interactive. The electronic book or the information picture is usually only suitable for a single crop, and a large amount of related electronic materials are required to be stored when a plurality of crop plants are planted, so that the operation is complicated and inconvenient, and the action key in the picking process cannot be dynamically and vividly shown in the mode; the picking technical difference of different crop varieties and tree types can not be dynamically and vividly simulated; the picking process cannot be intuitively simulated, and labels such as prompts and guidance of standard technologies, and reminders of cautionary items and the like are lacked in the picking process.
Disclosure of Invention
The invention aims to provide a crop picking demonstration method, a crop picking demonstration device, a crop picking demonstration system and a crop picking demonstration medium based on a 3D model, which are used for solving the technical problems of poor intuitiveness and interactivity of crop picking guidance in the prior art.
The invention provides a crop picking demonstration method based on a 3D model, which comprises the following steps:
constructing a 3D virtual sand table system for crop picking;
receiving growth parameters of a 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
receiving a picking stage and picking parameters of a user for picking the 3D standard tree model;
judging whether the picking parameters meet the picking parameter standards of the pre-stored 3D standard tree model in the picking stage or not;
if the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage; and displaying the picking snapshots of the 3D standard tree model after picking according to the picking parameters.
Preferably, the generating and displaying a virtual 3D standard tree model according to the picking parameters comprises:
acquiring and updating a 3D material model file corresponding to the picking parameters in a server; 3D material model files of different crops are stored in the server;
analyzing and rendering the 3D material model file into a 3D standard tree model;
and displaying the 3D standard tree model in the sand table system working area.
Preferably, before the receiving user performs picking stage and picking parameters of picking on the 3D standard tree model, the method further comprises:
and displaying the picking stages of the 3D standard tree model, picking parameters of each picking stage and attention points of each picking stage.
Preferably, the method further comprises:
after each picking, adjusting the 3D standard tree model according to the picking parameters of the picking and displaying the actual effect of the picking;
and when the user finishes the operation, storing the 3D standard tree model so as to call the 3D standard tree model for 3D printing by the user.
Preferably, the method further comprises:
and when receiving an undo instruction of a user, undoing the last picking operation on the 3D standard tree model.
Preferably, the method further comprises:
recording picking stages and picking parameters of a user, and inputting the picking stages and the picking parameters into a deep learning model for optimization;
when the user logs in again, the optimized picking stage and picking parameters are acquired and displayed.
Preferably, the constructing a 3D virtual sand table system for crop picking further comprises:
s11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
s12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
s13, inputting picking information needed by a user before picking, during picking and after picking;
and S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D.
The second aspect of the present invention also provides a crop picking demonstration device based on a 3D model, the device comprising:
the building module is used for building a 3D virtual sand table system for crop picking;
the receiving and displaying module is used for receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
the receiving module is used for receiving picking stages and picking parameters of picking of the 3D standard tree model by a user;
the judging module is used for judging whether the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage;
the display module is used for judging whether the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage or not; and displaying the picking snapshots of the 3D standard tree model after picking according to the picking parameters.
The third aspect of the invention provides a 3D model-based crop picking demonstration system, which comprises a server and the 3D model-based crop picking demonstration device.
A fourth aspect of the invention provides a storage medium having stored thereon computer program instructions which, when executed by a processor, implement the method of any of the above.
In conclusion, the 3D model-based crop picking demonstration method, the 3D model-based crop picking demonstration device, the 3D virtual sand table system and the medium provided by the invention replace the traditional picking operation teaching mode, so that the intuition and the interactivity of the crop picking process are improved, and the teaching demonstration cost is saved; and through the picking parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree type. Virtual picking operation in different picking periods can be carried out on the 3D standard tree model, and picking snapshots of the 3D standard tree model after picking are displayed by judging whether picking parameters of all picking stages meet the picking parameter standard of the current crop in the growing period. Compared with the prior art, the invention has the following beneficial effects:
1. the intuition and the interactivity of the crop picking process are improved, and the teaching demonstration cost is saved;
2. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional picking teaching mode is broken through;
3. virtual picking operation can be carried out through the 3D sand table system, and picking stages, picking parts and cautions can be prompted and guided.
4. And moving, picking and cancelling the command of the last operation on the 3D standard tree type through the 'moving, picking and cancelling' button.
Drawings
Fig. 1 shows a flow chart of a crop picking demonstration method based on a 3D model according to the present invention.
FIG. 2 shows a schematic diagram of a 3D model-based crop picking demonstration of the present invention
FIG. 3 illustrates another schematic view of a 3D model based crop picking demonstration of the present invention;
FIG. 4 is a schematic structural diagram of a 3D model-based crop picking demonstration device according to the present invention;
fig. 5 shows a schematic structural diagram of a crop picking demonstration device based on a 3D model according to the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Referring to fig. 1, the present invention provides a 3D model-based crop picking demonstration method, comprising:
s1, constructing a 3D virtual sand table system for crop picking;
the virtual sand table system refers to a virtual technology in the field of computers, and the basic principle is as follows: a virtual running environment is created according to the real running environment of a computer program, when a certain program tries to play a role, the program can be firstly run in a sand table, and all changes caused by the program in the sand table cannot cause any influence on the real running environment. The sand table can simulate a real operation environment, and the change caused by the operation of the program in the sand table can not cause any influence on the real operation environment. On the basis of researching military sand tables and building sand tables, the virtual sand table system comprehensively considers the characteristics of different types of crops, picking environments, the sizes of the crops and the fruits of the crops, illumination shadows and wind influences on the crops and the fruits in the actual picking environment, positioning of the fruits and the like, can meet the requirements of fruit picking and storage technology demonstration of various crop plants through the 3D virtual sand table system, can dynamically and vividly show action key fields in the picking process, including but not limited to fruit picking methods, storage methods, cautionary matters and the like, and can dynamically and vividly simulate different technical differences of fertilizer application and pesticide application in environments with different geographic positions, climates and temperature differences. The main method of the embodiment of the invention is as follows:
s11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
the method mainly comprises the following steps: the method comprises the steps that an unmanned aerial vehicle is used for carrying a binocular camera or a zoom lens to collect images of the terrain where crops are located, colors of satellite remote sensing images are combined, and the landform, three-dimensional coordinates, height, gradient, river, road and surrounding manually-set engineering images of the collected crop terrain are obtained through preset wave band combination and preset time phase selection, wherein the preset wave band combination and the preset time phase are determined by a user according to actual needs;
identifying different objects from the image, and extracting texture feature points of the objects;
and constructing a 3D electronic sand table without crops.
S12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
an unmanned aerial vehicle is adopted to carry a binocular camera or a zoom lens to shoot 3D images of crops, the types of the crops are identified, background images and shadow images of the crops in the images are removed according to the illumination intensity and the shooting angle, and the 3D outline shapes of the crops are displayed; of course, the construction of the 3D image of the fruit of the crop is also considered here, and since the fruit is randomly distributed on the 3D contour shape of the crop, the fruit needs to be distinguished from the leaves and branches of the crop (image segmentation technology may be used) and the position of the fruit on the 3D contour shape of the crop needs to be located when constructing; judging the ripeness of fruits, such as oranges, when the fruits are not ripe before picking, the orange color may be lighter, and judging the ripeness of the fruits according to the color. The above locating the position of the fruit on the 3D contour shape of the crop comprises the steps of: after the fruit image is collected, the fruit image is corrected, the fruit image is subjected to image processing, then Hough circle detection is used, 8 characteristic points are selected on the fruit, and the centroid coordinate of the fruit is calculated by adopting a least square method. The Hough circle detection and the least square method adopted in the method belong to algorithms which are common in the field of images, and are mainly characterized in that the combination of the Hough circle detection and the least square method is adopted, so that the accurate fruit shape can be obtained, and if the fruit is elliptical, the fruit is circular. But the position of the fruit on the crop can be more accurately located by finding the center of mass.
The method can be added with a deep learning algorithm to improve the accuracy of the 3D contour shape through continuous training. Here mainly includes: extracting image characteristics of crops and image characteristics of the environment where the crops are located; extracting image features of different crops and image features of the environment where the crops are located for multiple times to form a training set; extracting a training set by adopting a CNN (convolutional neural network) algorithm; then, learning and classifying by using an image classifier; and marking the classified crop characteristics and the environmental characteristics of the crop.
After the position of the fruits on the crops is positioned, collecting growth parameters of the crops and the fruits thereof in different growth stages;
constructing a 3D initial standard tree model with fruits according to the growth parameters of the fruits and crops at each stage and the corresponding 3D outline shapes;
s13, inputting picking information needed by the user before picking, during picking and after picking, including: variety name, climate parameters, preparation work, picking operation flow, cautions and the like.
And S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D. The text displayed on the display interface generally includes: picking information which needs to be displayed before picking, during picking and after picking, or interaction information of some 3D virtual sand table system operations. The display of the 3D virtual sand table system adopts a 2D/3D fusion display screen. According to the embodiment of the invention, the image part is displayed in a 3D mode, the character part is displayed in a 2D mode, 2D/3D co-fusion display is realized, the dizziness and the discomfort of people for reading 3D characters are overcome, the fidelity of the displayed three-dimensional image is improved, and the user experience is improved.
The above is a detailed description of constructing a 3D virtual sand table system for crop picking.
S2, receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters; the growing parameters and the image rendering technology are combined on the basis of the 3D initial standard tree model (the image rendering can be used for rendering colors according to the preference of a user)
The growth parameters include, but are not limited to, parameters such as crop varieties and tree types, wherein a tree type refers to a specific shape for generating a 3D standard tree, and may specifically include: circular, oval, etc. The user may enter growth parameters into the 3D virtual sand table system through a user interface. In this step, the generating and displaying the 3D standard tree model according to the growth parameters includes:
and S21, acquiring and updating the 3D material model file corresponding to the growth parameters in the server.
The server stores 3D material model files of different crops; specifically, 3D material modeling can be completed on a standard tree type, a root system, illumination and the like of a crop plant by using an Autodesk3D max tool; uploading the model source files of the '3 ds' material after the modeling is completed to a 3D virtual sand table system management background, and setting data such as crop, variety names, climate parameters and the like corresponding to each model file. After the client of the sand table system is started, the client automatically updates and acquires the material data of the server corresponding to the crops, varieties and attributes, and caches the material data to the local hard disk.
S22, analyzing and rendering the 3D material model file into a 3D standard tree model;
the 3D virtual sand table system is internally provided with a 3ds file analysis engine, and can read, analyze and render a 3D model file output by the 3D MAX into a 3D standard tree model. And generating a virtual 3D standard tree model (such as sugar orange tree type generated by sugar oranges) of the crop variety and the tree type according with the growth parameters by analyzing and rendering the corresponding 3D model materials, and adjusting the characteristics of the generated 3D standard tree model at different picking stages according to the picking period. Wherein, different picking stages include: before picking, during picking and after picking.
And S23, displaying the 3D standard tree model in the sand table system working area.
As shown in fig. 2, a 3D standard tree model of sugar oranges before picking is shown in the 3D virtual sand table system working area.
S3, receiving a picking stage and picking parameters of a user for picking the 3D standard tree model;
wherein the picking parameters include but are not limited to picking position and picking action position. The picking position can be the position of the geometric center of the fruit, the picking action position is the position of the action of the scissors pointer when the fruit is picked, and specifically the position of the fruit root within a preset range from the fruit can be used. The invention can specifically generate a scissor-shaped pointer at the picking part of the 3D standard tree model, and act on the picking action position of the 3D standard tree model to carry out pruning and picking operations. The picking stage comprises three stages of before picking, during picking and after picking.
S4, judging whether the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage;
in the invention, picking parameter standards of different picking stages of each 3D standard tree model can be stored in advance, and whether the picking parameters meet the picking parameter standards of the 3D standard tree model in the picking stages in advance is judged by comparing the picking parameters with the picking parameter standards of the picking stages of the 3D standard tree model in advance. For example, for a sugar orange tree type, the pre-picking parameter criteria may be set to be within a first preset range in which the picking position is the picking site, and the in-picking parameter criteria may be set to be within a second preset range in which the picking position is the picking site. Specifically, the second preset range is set to be 1CM, and if the picking action position exceeds the range of 1CM of the picking part in picking, the picking is automatically cancelled, and the picking is prompted to be not in accordance with the picking standard.
S5, if the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage, displaying the picking snapshot of the 3D standard tree model after picking according to the picking parameters.
After a picking operation, a picking snapshot of the 3D standard tree model after picking will be displayed in the work area in the upper right corner of the sand table system, as shown in fig. 3.
In addition, in order to increase interestingness, an animation area which is made into life with crops is arranged on a display interface of the 3D virtual sand table system, for example, when the fruits are picked, the mature fruit system can give out a voice that 'I' is mature and picks me ', and for immature fruits, the system gives out a voice that' I 'is immature and so on'. Therefore, a preset number of display areas are divided on the display interface of the 3D virtual sand table system according to the needs of a user, and the interestingness of interaction is enhanced through the combination of sound and animation.
In an embodiment of the present invention, to improve the learning effect of the demonstration, the display of the 3D virtual sand table system adopts a touch display screen, characters on the display screen are displayed in 2D, and crops, picking-related tools, etc. are all displayed in 3D, which is characterized in that: the real picking environment is simulated, teaching is carried out in lively activities, and the specific interactive control method comprises the following steps:
after receiving a user touch instruction, starting a 3D virtual sand table system, entering a starting interface of a touch screen, and enabling a crop type dialog box to be arranged on the starting interface;
receiving a touch instruction of selecting a crop type by a user, and displaying a corresponding crop 3D standard tree type;
receiving a growing stage selection instruction of a user on the selected crops;
popping up a dialog box whether the fruit in the growth stage can be picked or not;
if the picking tool can be picked, displaying the holding mode of the picking tool;
then, the picking tool is controlled to move to the fruit on the screen, the position relation of the picking tool on the fruit is prompted, and how to control the picking tool to pick the fruit is prompted;
inputting a fruit picking instruction by touch control, picking fruits and moving the fruits to a fruit basket of a screen;
prompting how to place the fruit into the fruit basket; the problem here is that the fruit is easily damaged when the fruit is simulated in practice, and the quality of the fruit is poor.
And moving the fruits on the screen into the fruit basket according to the prompt.
In addition, the remote wireless control learning can be realized, the 3D virtual sand table system is installed in the server, a user is connected to the server at a far end even in a crop picking site through a handheld electronic device terminal through a wireless network, the user logs in the 3D virtual sand table system remotely to watch picking demonstration, and meanwhile the handheld electronic device terminal and the 3D virtual sand table system are used for real-time interaction.
With the great application of the augmented reality technology, the embodiment of the invention can also combine the 3D virtual sand table system with the augmented reality technology, and the crop picking demonstration method based on the 3D model further comprises the following steps:
displaying the collected crops, fruits on the crops and environment images thereof in real time;
identifying crop species;
the 3D virtual sand table system is pre-stored with a plurality of crops and picking modes thereof, a 3D standard tree model with similar growth conditions and a 3D sand table in a similar environment; it should be noted that the picking mode of apples is different from that of grapes, litchis and the like, and the picking mode of hard shell fruits such as walnuts is different from the previous picking mode.
The 3D virtual sand table system demonstrates the picking video of the crop;
the user who wears AR equipment is reminded to watch through the display screen at AR equipment and picks the video to guide the user to carry out the picking operation to the crops fruit according to this video, the demonstration is carried out simultaneously, the picture of user's on-the-spot picking is gathered simultaneously, if pick the picture and pick the picture that the virtual sand table system of 3D prestores when having great difference, the suggestion user improves the operation, until the user picks the action and accords with the requirement, just so stopped to pick the problem that the non-standard leads to the fruit to damage, user's picking technical level and fruit quality have been promoted.
According to the crop picking demonstration method based on the 3D model, the 3D virtual sand table system is adopted to replace a traditional picking operation teaching mode, the intuition and the interactivity of the crop picking process are improved, and the teaching demonstration cost is saved; and through the picking parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree type. Virtual picking operation in different picking periods can be carried out on the 3D standard tree model, and picking snapshots of the 3D standard tree model after picking are displayed by judging whether picking parameters of all picking stages meet the picking parameter standard of the current crop in the growing period. Compared with the prior art, the invention has the following beneficial effects:
1. the intuition and the interactivity of the crop picking process are improved, and the teaching demonstration cost is saved;
2. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional picking teaching mode is broken through;
3. virtual picking operation can be carried out through the 3D sand table system, and picking stages, picking parts and cautions can be prompted and guided.
4. And moving, picking and cancelling the command of the last operation on the 3D standard tree type through the 'moving, picking and cancelling' button.
The invention also provides another crop picking demonstration method based on the 3D model, which is different from the method in the figure 1 in that:
between the steps S2 and S3, the method further comprises:
s21, displaying the picking stages of the 3D standard tree model, picking parameters of all the picking stages and cautions of all the picking stages.
Wherein the picking stage comprises before picking, during picking and after picking. As shown in fig. 2, pre-picking parameters and precautions are prompted at the bottom of the 3D sand table system work area prior to picking.
After the step S5, the method further includes:
and S51, after each picking, adjusting the 3D standard tree model according to the picking parameters of the picking at this time to display the actual effect after the picking at this time.
Specifically referring to fig. 3, the condition of the remaining fruits of the 3D standard tree model after the current picking is displayed in the 3D virtual sand table system, and meanwhile, the picking snapshot of the 3D standard tree model after the picking is displayed in the working area at the upper right corner.
And S52, when receiving an undo instruction of the user, undoing the last picking operation of the 3D standard tree model.
As shown in fig. 3, the working area of the 3D virtual sand table system is displayed with: moving, picking and cancelling, wherein the user clicks a cancel button to cancel the last picking operation on the 3D standard tree model; and the user clicks the mobile button to move the current 3D standard tree type, and the user clicks the picking button after inputting the picking parameters to pick the 3D standard tree type.
S53, recording the picking stage and picking parameters of the user, and inputting the picking stage and picking parameters into a deep learning model for optimization; when the user logs in again, the optimized picking stage and picking parameters are acquired and displayed.
In the invention, a Google TensorFlow AI framework can be specifically adopted for deep learning and algorithm optimization.
And S54, when the user finishes the operation, storing the 3D standard tree model so as to finish the printing of the 3D standard tree model.
Fig. 4 is a 3D model-based crop picking demonstration device provided by the invention, the device comprising:
the building module 41 is used for building a 3D virtual sand table system for crop picking;
the receiving and displaying module 42 is configured to receive a growth parameter of the 3D virtual sand table system set by a user, and generate and display a 3D standard tree model according to the growth parameter;
a receiving module 43, configured to receive a picking stage and picking parameters of a user for picking the 3D standard tree model;
a judging module 44, configured to judge whether the picking parameters meet picking parameter standards of the pre-stored 3D standard tree model in the picking stage;
a display module 45, configured to, if the picking parameter meets a pre-stored picking parameter standard of the 3D standard tree model in the picking stage; and displaying the picking snapshots of the 3D standard tree model after picking according to the picking parameters.
In one embodiment, the receiving and displaying module 42 includes:
the acquisition module is used for acquiring and updating the 3D material model file corresponding to the picking parameters in the server; 3D material model files of different crops are stored in the server;
the analysis rendering module is used for analyzing and rendering the 3D material model file into a 3D standard tree model;
and the sub-display module is used for displaying the 3D standard tree model in the sand table system working area.
Further, the apparatus further comprises:
the first display module is used for displaying the picking stages of the 3D standard tree model, picking parameters of all the picking stages and cautions of all the picking stages.
And the second display module is used for adjusting the 3D standard tree model according to the picking parameters of the picking at this time to display the actual effect of the picking at this time after every picking.
And the cancelling module is used for cancelling the latest picking operation on the 3D standard tree model when a cancelling instruction of a user is received.
The optimization module is used for recording the picking stage and picking parameters of a user and inputting the picking stage and picking parameters into the deep learning model for optimization;
and the third display module is used for acquiring and displaying the optimized picking stage and picking parameters when the user logs in again.
And the storage module is used for storing the 3D standard tree model when the user finishes the operation so as to finish the printing of the 3D standard tree model.
The invention also provides a crop picking demonstration system based on the 3D model, which comprises a server and any one of the crop picking demonstration devices based on the 3D model.
In addition, the 3D model-based crop picking demonstration method of the embodiment of the present invention described in conjunction with fig. 1 may be implemented by a 3D model-based crop picking demonstration apparatus. Fig. 5 is a schematic diagram illustrating a hardware structure of a 3D model-based crop picking demonstration apparatus according to an embodiment of the present invention.
The 3D model based crop picking demonstration apparatus may comprise at least one processor 401, at least one memory 402 and computer program instructions stored in the memory 402 which when executed by the processor 401 implement the method of the present embodiment.
Specifically, the processor 401 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing embodiments of the present invention.
Memory 402 may include mass storage for data or instructions. By way of example, and not limitation, memory 402 may include a Hard Disk Drive (HDD), floppy Disk Drive, flash memory, optical Disk, magneto-optical Disk, tape, or Universal Serial Bus (USB) Drive or a combination of two or more of these. Memory 402 may include removable or non-removable (or fixed) media, where appropriate. The memory 402 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 402 is a non-volatile solid-state memory. In a particular embodiment, the memory 402 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The processor 401 reads and executes the computer program instructions stored in the memory 402 to implement the 3D model-based crop picking demonstration method in the above-described embodiment.
In one example, the 3D model-based crop picking presentation device may also include a communication interface 403 and a bus 410. As shown in fig. 5, the processor 401, the memory 402, and the communication interface 403 are connected via a bus 410 to complete communication therebetween.
The communication interface 403 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present invention.
By way of example, and not limitation, buses may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low pin count (L PC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards Association local (V L B) bus, or other suitable bus, or a combination of two or more of these.
In addition, in combination with the 3D model-based crop picking demonstration method in the foregoing embodiments, embodiments of the present invention may be implemented by providing a computer-readable storage medium. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the 3D model-based crop picking demonstration methods of the above embodiments.
In conclusion, the 3D model-based crop picking demonstration method, device and system provided by the invention have the advantages that the 3D virtual sand table system is adopted to replace the traditional picking operation teaching mode, so that the intuition and interactivity of the crop picking process are improved, and the teaching demonstration cost is saved; and through the picking parameters set by the user, the 3D virtual sand table system automatically calls the built-in material library to generate a 3D standard tree type. Virtual picking operation in different picking periods can be carried out on the 3D standard tree model, and picking snapshots of the 3D standard tree model after picking are displayed by judging whether picking parameters of all picking stages meet the picking parameter standard of the current crop in the growing period. Compared with the prior art, the invention has the following beneficial effects:
1. the intuition and the interactivity of the crop picking process are improved, and the teaching demonstration cost is saved;
2. crops and varieties needing to be operated can be selected, and the limitation of single variety in the traditional picking teaching mode is broken through;
3. virtual picking operation can be carried out through the 3D sand table system, and picking stages, picking parts and cautions can be prompted and guided.
4. And moving, picking and cancelling the command of the last operation on the 3D standard tree type through the 'moving, picking and cancelling' button.
It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As described above, only the specific embodiments of the present invention are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present invention, and these modifications or substitutions should be covered within the scope of the present invention.

Claims (10)

1. Crop picking demonstration method based on 3D model, characterized in that the method comprises:
constructing a 3D virtual sand table system for crop picking;
receiving growth parameters of a 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
receiving a picking stage and picking parameters of a user for picking the 3D standard tree model;
judging whether the picking parameters meet the picking parameter standards of the pre-stored 3D standard tree model in the picking stage or not;
and if the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage, displaying the picking snapshots of the 3D standard tree model after picking according to the picking parameters.
2. The 3D model-based crop picking demonstration method of claim 1, wherein the generating and displaying a 3D standard tree model according to the growth parameters comprises:
acquiring and updating the 3D material model file corresponding to the growth parameter in a server; 3D material model files of different crops are stored in the server;
analyzing and rendering the 3D material model file into a 3D standard tree model;
and displaying the 3D standard tree model in the sand table system working area.
3. The 3D model-based crop picking presentation method of claim 2, wherein the receiving user is prior to a picking stage and picking parameters of the 3D standard tree model for picking, the method further comprising:
and displaying the picking stages of the 3D standard tree model, picking parameters of each picking stage and attention points of each picking stage.
4. The 3D model-based crop picking demonstration method of claim 3, further comprising:
after each picking, adjusting the 3D standard tree model according to the picking parameters of the picking and displaying the actual effect of the picking;
and when the user finishes the operation, storing the 3D standard tree model so as to call the 3D standard tree model for 3D printing by the user.
5. The 3D model-based crop picking demonstration method of claim 3, further comprising:
and when receiving an undo instruction of a user, undoing the last picking operation on the 3D standard tree model.
6. The 3D model-based crop picking demonstration method of claim 3, further comprising:
recording picking stages and picking parameters of a user, and inputting the picking stages and the picking parameters into a deep learning model for optimization;
when the user logs in again, the optimized picking stage and picking parameters are acquired and displayed.
7. The 3D model-based crop picking presentation method of any one of claims 1 to 6, wherein the constructing a 3D virtual sand table system for crop picking further comprises:
s11, collecting locus shape data of crops, and constructing a 3D electronic sand table of the region where the crops are located by combining a GIS;
s12, collecting 3D images of crops, identifying the types of the crops, and constructing a 3D virtual sand table system containing the crops by combining a 3D electronic sand table of the environment where the crops are located;
s13, inputting picking information needed by a user before picking, during picking and after picking;
and S14, respectively displaying images of characters and graphics in the 3D virtual sand table system, displaying the characters in 2D on the same display interface in the 3D virtual sand table system, and displaying crops, fruits and the surrounding environment of the crops in 3D.
8. A crop picking demonstration apparatus based on a 3D model, the apparatus comprising:
the building module is used for building a 3D virtual sand table system for crop picking;
the receiving and displaying module is used for receiving growth parameters of the 3D virtual sand table system set by a user, and generating and displaying a 3D standard tree model according to the growth parameters;
the receiving module is used for receiving picking stages and picking parameters of picking of the 3D standard tree model by a user;
the judging module is used for judging whether the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage;
the display module is used for judging whether the picking parameters meet the pre-stored picking parameter standards of the 3D standard tree model in the picking stage or not; and displaying the picking snapshots of the 3D standard tree model after picking according to the picking parameters.
9. A 3D model based crop picking presentation system, the system comprising a server and a 3D model based crop picking presentation device according to claim 8.
10. A storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-7.
CN202010212188.1A 2020-03-24 2020-03-24 Crop picking demonstration method, device, system and medium based on 3D model Active CN111508059B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010212188.1A CN111508059B (en) 2020-03-24 2020-03-24 Crop picking demonstration method, device, system and medium based on 3D model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010212188.1A CN111508059B (en) 2020-03-24 2020-03-24 Crop picking demonstration method, device, system and medium based on 3D model

Publications (2)

Publication Number Publication Date
CN111508059A true CN111508059A (en) 2020-08-07
CN111508059B CN111508059B (en) 2023-09-12

Family

ID=71877828

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010212188.1A Active CN111508059B (en) 2020-03-24 2020-03-24 Crop picking demonstration method, device, system and medium based on 3D model

Country Status (1)

Country Link
CN (1) CN111508059B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103105929A (en) * 2013-01-05 2013-05-15 北京农业信息技术研究中心 Interactive design and experience method of virtual agricultural park and system
CN104067781A (en) * 2014-06-16 2014-10-01 华南农业大学 Virtual robot and real robot integration based picking system and method
CN104966430A (en) * 2015-06-09 2015-10-07 北京农业智能装备技术研究中心 Grape vine binding simulation training system and method
CN106846954A (en) * 2017-02-09 2017-06-13 广东小天才科技有限公司 A kind of interactive digital method and apparatus
CN108961909A (en) * 2018-09-06 2018-12-07 佛山三水芦苞吉星普照智能农业科技有限公司 It is a kind of to the miniature farm of intelligence imparted knowledge to students and its management system
CN208521255U (en) * 2018-06-26 2019-02-19 杭州书微信息科技有限公司 A kind of man-machine interactive system based on virtual reality
CN109635347A (en) * 2018-11-15 2019-04-16 江苏农林职业技术学院 A kind of overhead Strawberry in Greenhouse production of intelligent facility virtual emulation platform
JP2019061453A (en) * 2017-09-26 2019-04-18 株式会社Nttドコモ Information processing apparatus

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103105929A (en) * 2013-01-05 2013-05-15 北京农业信息技术研究中心 Interactive design and experience method of virtual agricultural park and system
CN104067781A (en) * 2014-06-16 2014-10-01 华南农业大学 Virtual robot and real robot integration based picking system and method
CN104966430A (en) * 2015-06-09 2015-10-07 北京农业智能装备技术研究中心 Grape vine binding simulation training system and method
CN106846954A (en) * 2017-02-09 2017-06-13 广东小天才科技有限公司 A kind of interactive digital method and apparatus
JP2019061453A (en) * 2017-09-26 2019-04-18 株式会社Nttドコモ Information processing apparatus
CN208521255U (en) * 2018-06-26 2019-02-19 杭州书微信息科技有限公司 A kind of man-machine interactive system based on virtual reality
CN108961909A (en) * 2018-09-06 2018-12-07 佛山三水芦苞吉星普照智能农业科技有限公司 It is a kind of to the miniature farm of intelligence imparted knowledge to students and its management system
CN109635347A (en) * 2018-11-15 2019-04-16 江苏农林职业技术学院 A kind of overhead Strawberry in Greenhouse production of intelligent facility virtual emulation platform

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
吕萌萌 等: "基于 Unity 3D果树交互虚拟修剪技术及其实现", 《农机化研究》, no. 4 *
吴升 等: "基于 Unity3D 的甘蔗种植虚拟教育培训***设计与实现", 《中国农业科技导报》, no. 6 *
田世平 等: "模拟果树修剪***研究", 《农业网络信息》, no. 2 *

Also Published As

Publication number Publication date
CN111508059B (en) 2023-09-12

Similar Documents

Publication Publication Date Title
US11935282B2 (en) Server of crop growth stage determination system, growth stage determination method, and storage medium storing program
JP2019520631A (en) Weed recognition in the natural environment
US11640704B2 (en) Generating and using synthetic training data for plant disease detection
JP6273473B2 (en) Forest information management device
US20210053229A1 (en) Coordinating agricultural robots
CN108633533B (en) Tree automatic tending method and device, electronic equipment and storage medium
JP4961555B2 (en) Method for locating target part of plant, target part locating device by the method, and working robot using the device
CN112465038A (en) Method and system for identifying disease and insect pest types of fruit trees
CN111552762A (en) Orchard planting digital map management method and system based on fruit tree coding
CN116507004A (en) Plant illumination adjustment method, electronic device and storage medium
CN110415130A (en) Agricultural insurance Claims Resolution method, apparatus, equipment and computer readable storage medium
JP7039766B2 (en) On-site work support system
CN111508078A (en) Crop pruning demonstration method, device and system based on 3D model
CN111508059B (en) Crop picking demonstration method, device, system and medium based on 3D model
CN112115885A (en) Fruit tree bearing branch shearing point positioning method for picking based on deep convolutional neural network
CN110555343B (en) Method and system for extracting three elements of forest, shrub and grass in typical resource elements
CN115294472A (en) Fruit yield estimation method, model training method, equipment and storage medium
CN109344188B (en) Artificial intelligence statistical method for remote sensing satellite efficiency
CN111508060A (en) Crop fertilization and pesticide application demonstration method, device and system based on 3D model
CN111279284B (en) Control method and apparatus
CN108932088B (en) Virtual object collection method and portable electronic device
US12001512B2 (en) Generating labeled synthetic training data
JP2022094331A (en) Actual estimation system, actual harvest system, branch stem estimation system, learning system, actual estimation method and actual estimation program
Roo Architectural Phenotype Measurements Utilizing High Throughput Phenotyping in Solanaceae Varieties
Lourenço et al. Virtual Environments & Precision Viticulture: A Case Study

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant