WO2021255941A1 - Crop growth management device and crop growth management method - Google Patents

Crop growth management device and crop growth management method Download PDF

Info

Publication number
WO2021255941A1
WO2021255941A1 PCT/JP2020/024247 JP2020024247W WO2021255941A1 WO 2021255941 A1 WO2021255941 A1 WO 2021255941A1 JP 2020024247 W JP2020024247 W JP 2020024247W WO 2021255941 A1 WO2021255941 A1 WO 2021255941A1
Authority
WO
WIPO (PCT)
Prior art keywords
shooting
information
crop
growth
management device
Prior art date
Application number
PCT/JP2020/024247
Other languages
French (fr)
Japanese (ja)
Inventor
宮崎忠喜
西片丈晴
和氣千大
加藤宏記
Original Assignee
株式会社ナイルワークス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ナイルワークス filed Critical 株式会社ナイルワークス
Priority to JP2022531241A priority Critical patent/JPWO2021255941A1/ja
Priority to PCT/JP2020/024247 priority patent/WO2021255941A1/en
Publication of WO2021255941A1 publication Critical patent/WO2021255941A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01G—HORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING
    • A01G7/00—Botany in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/02—Agriculture; Fishing; Forestry; Mining

Definitions

  • the present invention relates to a crop growth management device and a growth management method.
  • the computer 3 has a communication unit, a growth information generation unit that generates growth information based on an image, and a portable communication terminal device that corresponds to the identification information, and the growth information generated by the growth information generation unit.
  • the portable communication terminal device 2 has an information providing unit for displaying growth information on the display unit of the portable communication terminal device 2.
  • the portable communication terminal device 2 includes a display unit 25, a communication unit, and a filter.
  • the photographing unit 21 that acquires an image by photographing the reflected light of the plant to be measured through a filter, and the spectral image and the identification information are associated with each other and transmitted to the computer 3 via the communication unit and received from the computer 3. It has a control circuit for displaying the growth information and growth diagnosis information of the plant P1 to be measured on the display unit 25 "(see summary).
  • the patent document 1 describes a system for performing a growth diagnosis based on an image taken by a portable communication terminal device.
  • Patent Document 1 only the image information transmitted from the portable communication terminal device is analyzed by a computer, and the imaging conditions suitable for determining the growth state of the crop are not considered. Therefore, the present invention provides a mechanism for acquiring a more suitable image for determining the growth state of a crop.
  • the present application includes a plurality of means for solving the above-mentioned problems.
  • an acquisition unit for acquiring image information taken by a camera and a crop growth state are determined based on the acquired image information.
  • a crop growth management device having a determination unit and an output unit for outputting information, wherein the output unit outputs information regarding imaging conditions for determining the growth state of the crop. ..
  • FIG. 1 is an example of a connection configuration diagram of the entire crop growth management system 100.
  • the growth management system 100 includes a drone 101, a mobile terminal 102, and a base station 110, each of which is connected to the management server 103 via a network.
  • the network may be wired or wireless, and each terminal can send and receive information via the network.
  • the network may be a network that communicates according to one communication standard, or may be a network that is a combination of a plurality of communication standard networks.
  • the drone 101 and the mobile terminal 102 may be network-connected by Wi-Fi (registered trademark) provided by the base station 110, respectively, and the drone 101 and the mobile terminal 102 may be network-connected by a mobile communication network such as LTE, respectively. You may. Further, the drone 101 may be connected by Wi-Fi provided by the base station 110, and the base station 110 and the mobile terminal 102 may be connected by a mobile communication network.
  • the mobile terminal 102 is realized by, for example, a portable information device such as a tablet terminal or a smartphone having a camera, or a camera device having a communication function.
  • the image of the crop taken by the mobile terminal 102 or the processing data obtained by processing the image by the mobile terminal is transmitted to the management server 103 via the network, and the management server 103 executes the crop growth diagnosis.
  • the drone 101 performs autonomous flight by an instruction from the management server 103 or by the mobile terminal 102, but can be manually operated by the mobile terminal 102.
  • the mobile terminal 102 is connected to the base station 110, and can communicate with the management server 103 directly or via the base station 110.
  • the management server 103 is, for example, a server arranged on the cloud, and analyzes images and sensor information transmitted from cameras and various sensors mounted on the mobile terminal 102 and the drone 101 to determine the state of fields and crops. Various analyzes can be performed.
  • the base station 110 is a device installed in the field 120 and providing a master unit function for Wi-Fi communication, and also functions as an RTK-GPS base station, so that the accurate position of the drone 101 can be provided. (The base unit function of Wi-Fi communication and the RTK-GPS base station may be independent devices). Further, the base station 110 can communicate with the management server 103 using a mobile communication network such as 3G, 4G, and LTE.
  • Each terminal or management server 103 of the crop growth management system 100 may be a mobile terminal (mobile terminal) such as a smartphone, a tablet, a mobile phone, or a mobile information terminal (PDA), or may be a glasses type, a wristwatch type, or a clothing type. It may be a wearable terminal such as a type. It may also be a stationary or portable computer, or a server located in the cloud or on a network. Further, the function may be a VR (Virtual Reality) terminal, an AR (Augmented Reality) terminal, or an MR (Mixed Reality) terminal. Alternatively, it may be a combination of these plurality of terminals. For example, a combination of one smartphone and one wearable terminal can logically function as one terminal. Further, it may be an information processing terminal other than these.
  • Each terminal and management server 103 of the growth management system 100 has a processor (control unit) that executes an operating system, an application, a program, etc., a main storage device such as a RAM (RandomAccessMemory), and an IC card or a hard disk drive. , SSD (Solid State Drive), auxiliary storage device such as flash memory, communication control unit such as network card, wireless communication module, mobile communication module, touch panel, keyboard, mouse, voice input, motion detection by imaging of camera unit It is equipped with an input device such as an input device and an output device such as a monitor and a display.
  • the output device may be a device or a terminal for transmitting information for output to an external monitor, display, printer, device, or the like.
  • each module is stored in the main memory, and each functional element of the entire system is realized by the processor executing these programs and applications.
  • each of these modules may be implemented by hardware by integrating them.
  • each module may be an independent program or application, but may be implemented in the form of a part of a subprogram or a function in one integrated program or application.
  • each module is described as a subject (subject) that performs processing, but in reality, a processor that processes various programs, applications, etc. (module) executes processing.
  • DBs databases
  • a "database” is a functional element (storage unit) that stores a data set so that it can handle arbitrary data operations (for example, extraction, addition, deletion, overwriting, etc.) from a processor or an external computer.
  • the method of implementing the database is not limited, and may be, for example, a database management system, spreadsheet software, or a text file such as XML or JSON.
  • the growth management mechanism in this embodiment can be implemented by the management server 103 in cooperation with the mobile terminal 102 in the growth management system 100, or can be implemented by the mobile terminal 102 alone. Therefore, the management server 103 may be referred to as a growth management device, and the mobile terminal 102 may be referred to as a growth management device.
  • FIG. 2 is an example of the hardware configuration of the mobile terminal 102.
  • the mobile terminal 102 is, for example, a terminal such as a tablet, a smartphone, a head-mounted display, or a camera.
  • Programs and applications such as a shooting information management module 211, a growth state management module 212, and a shooting management module 213 are stored in the main storage device 201, and the processor 203 executes these programs and applications to carry out the mobile terminal 102.
  • Each functional element of is realized.
  • the photographing information management module 211 manages the image information photographed by the camera unit 206 and the information regarding the fields and crops acquired by the input device 204 such as various sensors, and stores the information in the photographing information management information 700. Further, these stored information is transmitted to the management server 103.
  • the growth state management module 212 displays the growth state management information 800 such as the growth diagnosis information of the crop received from the management server 103 on the output device 205 such as a monitor or a panel. Further, in the case of a configuration in which the image is analyzed and the growth diagnosis is performed by the mobile terminal 102 alone, the growth state management module 212 analyzes the image, determines the growth state of the crop, and obtains the growth state management information 800 such as the growth diagnosis information. calculate.
  • the shooting management module 213 displays the shooting conditions described in the shooting condition management information 600 transmitted from the management server 103, and shoots a photographic image that matches the conditions.
  • the auxiliary storage device 202 stores various information such as map information 400 in which map information to be displayed on the screen is stored, field management information 500, shooting condition management information 600, shooting information management information 700, and growth state management information 800. do.
  • FIG. 3 is an example of another hardware configuration of the mobile terminal 102.
  • the mobile terminal 102 is a camera device 20 having a communication function such as a single-lens reflex camera or a compact camera.
  • the camera device 20 has a camera unit 21 including a lens and an image pickup unit.
  • the camera device 20 has a camera controller (camera control unit) 22 that controls the entire camera unit 21, and has a camera capture 23 that gives an instruction for shooting to the camera unit 21.
  • the camera device 20 has an image processing unit (image processor) 24 that preprocesses the image captured by the camera unit.
  • the camera device 20 has a storage device 25 such as an SSD, and can store captured images, preprocessed image data, and the like.
  • the camera device 20 also has a transmission device 26, and can transmit raw data of captured images, data of preprocessed images, and the like to an external management server 103 and the like.
  • a cloud device 28 such as a management server 103 by using application software 27 or the like that synchronizes files and directories between remote locations.
  • the camera device 20 can be mounted on the drone 101, and can also be provided with a connection portion for connecting to the drone 101.
  • the camera device 20 may be mounted at the time of manufacturing the drone 101, or may be mounted after the drone 101.
  • the camera device 20 When the camera device 20 is mounted on the drone 101, it can be connected to the flight controller 501 and data such as captured images can be transmitted to the flight controller 501. In addition, in cooperation with the flight controller 501, it is possible to take a picture during the flight of the drone 101.
  • the camera device 20 can receive information such as the position, speed, attitude, time, flight status (mission status), and altitude above ground level of the drone 101 from the flight controller 501. Further, the camera unit can execute the shooting process according to the instruction from the flight controller 501.
  • the camera unit may be an infrared light camera, an ultraviolet light camera, or a multispectral camera capable of acquiring a plurality of wavelengths, in addition to a normal visible light camera.
  • FIG. 4 is an example of the hardware configuration of the management server 103.
  • the management server 103 is composed of, for example, a server arranged on the cloud.
  • Programs and applications such as a shooting information management module 411, a growth state management module 412, and a shooting condition management module 413 are stored in the main storage device 401, and a management server is executed by the processor 403 executing these programs and applications.
  • Each functional element of 103 is realized.
  • the shooting information management module 411 receives image information taken by the camera unit 206 of the mobile terminal 102 and information about fields and crops acquired by the input device 204 such as various sensors from the mobile terminal 102, and manages the shooting information. It is stored and managed in the information 700.
  • the growth state management module 412 analyzes images and information about fields and crops received from the mobile terminal 102, and determines the growth state of the crop.
  • the growth state management module 412 stores the growth state determination result as the growth state management information 800 in the auxiliary storage device 402, and also sends the information such as an image to the mobile terminal 102 that has sent the information.
  • the photographing condition management module 413 calculates and manages the photographing conditions of the image used for determining the growth state.
  • the auxiliary storage device 402 stores various information such as map information 400, field management information 500, imaging condition management information 600, imaging information management information 700, and growth state management information 800.
  • the respective information may be synchronized with each other, or one of the information may be simply copied by the other.
  • a configuration may be configured in which some or all of the information is stored in the management server 103, and the information is downloaded from the management server 103 from the mobile terminal 102 as needed.
  • the camera device 20 and a device such as a smartphone may be linked to form the mobile terminal 102 as one body.
  • information such as an image is transferred from the camera device 20 to the smartphone and the management server is transferred via the communication function of the smartphone. It is possible to transmit shooting information such as an image to 103.
  • the camera device 20 does not have a sensor for acquiring position information, orientation information, etc., the information acquired by the GPS function of the smartphone or the orientation measurement function by the electronic compass can be utilized.
  • the camera device 20 can store and transmit an image in association with such information.
  • the camera device 20 processes the captured image in the image processing unit 24, and transmits the processed image information to the smartphone via a wireless or wired network.
  • the smartphone displays the received processed image, associates the image information with the position information acquired by the smartphone (GPS position information, shooting direction, distance from the object, etc.), and transmits the image information to the management server 103. ..
  • the management server 103 analyzes and diagnoses the growth state of the crop based on the received image information and position information, and transmits the determination result (growth diagnosis result) of the growth state to the smartphone.
  • the smartphone displays the growth diagnosis result received from the management server 103.
  • the smartphone transmits the position information acquired by the GPS function to the camera device 20, and the camera device 20 transmits the processed image and the position information to the management server 103.
  • the growth state of the crop is analyzed and diagnosed based on the received image information and position information, and the determination result (growth diagnosis result) of the growth state is transmitted to the smartphone or the camera device 20.
  • the camera device 20 sends the processed image to the management server 103, the smartphone sets the location information to the management server 103, the management server 103 associates these information, and then the received image.
  • the growth state of the crop is analyzed and diagnosed based on the information and the position information, and the determination result (growth diagnosis result) of the growth state is transmitted to the smartphone or the camera device 20.
  • FIG. 5 is an example of the field management information 500.
  • the field management information 500 stores various information about the field in which the crop for determining the growth state of the crop is grown, and includes the field ID, the field name, the field position 511, the field surrounding coordinates 512, the field area 513, and the topographical information. Information such as 514, soil information 515, and cultivated crop 516 is stored.
  • the field management information 500 may be simply referred to as field information.
  • the field ID is identification information that uniquely identifies the field.
  • the field position 511 indicates the position coordinates of the field, and has, for example, information on the latitude and longitude of the center of the field.
  • the field circumference coordinate 512 indicates the coordinates around the field, and is, for example, the position coordinates of the four corners in the case of a quadrangular field.
  • the sample value GC007 indicates a link to information in which the position coordinates are continuously stored separated by commas or the like.
  • the field area 513 is the total area of the field corresponding to the field ID.
  • the topographical information 514 is information on the topography of the field such as the position of the floodgate and the position of the sun and shade at a specific date and time. These information can be calculated based on the field position 511 and the field surrounding coordinates 512 of the map information 400 and the field management information 500, and the information confirmed in advance by surveying or the like is stored.
  • Soil information 515 provides a link to information about the soil in the field.
  • the information about soil is, for example, detection information of soil components.
  • the cultivated crop 516 shows information for identifying the crop or the like cultivated in the field.
  • information on crop planting such as the orientation of crop strips and general growth processes, is also stored.
  • FIG. 6 is an example of the shooting condition management information 600.
  • the shooting condition management information 600 stores conditions for shooting crops and fields, and condition ID 611, condition name 612, shooting position 613, shooting direction 614, shooting angle 615, shooting procedure 616, and shooting distance. Information such as 617, shooting location 618, shooting time 619, shooting setting 621, etc. is stored.
  • the condition ID 611 is identification information that uniquely identifies the condition.
  • the condition name 612 stores the name so that it can be easily understood when displaying the condition.
  • the shooting position 613 stores position coordinates for shooting, for example, position information about the field specified by the field ID, latitude, longitude, height information from the ground surface, and the like.
  • the example “farm007-360613.58926, 1400516.27816-80cm” described in the shooting position 613 has a latitude of 36 degrees 06 minutes 13.58926 seconds, a longitude of 140 degrees 05 minutes 16.27816 seconds, and a height of 80 cm from the ground surface for a field with a field ID of farm007. Indicates a position.
  • the shooting direction 614 stores the shooting direction.
  • the example "270" described in the shooting direction 614 indicates that the direction is 270 degrees clockwise from the north, that is, facing the true west.
  • the shooting angle 615 stores the shooting angle. For example, with the horizontal direction as 0, a positive angle upward and a negative angle downward are used, and the example "-30" described in the shooting angle 615 indicates a direction of 30 degrees downward from the horizontal direction.
  • the shooting procedure 616 a procedure for performing shooting is stored. By displaying this shooting procedure on the mobile terminal 102, it is possible to encourage the photographer to shoot according to this procedure. Examples of the shooting procedure include taking a picture of the sky light and then taking a picture of the crop, or taking a picture of the plant root, the whole, and the tip of the ear in that order.
  • the shooting distance 617 indicates the distance from the crop or the ground surface when shooting.
  • the shooting location 618 indicates a location (shooting location) of the subject to be photographed.
  • the shooting time 619 stores the date and time of shooting.
  • the example "0810-0820" described in the shooting time 619 indicates that shooting is performed between August 10th and August 20th. You can also set a specific date and time instead of a period.
  • the shooting setting 621 stores image acquisition setting information when shooting. For example, exposure settings such as shutter speed and aperture value, number of pixels, histogram adjustment, etc. are stored.
  • FIG. 7 is an example of the shooting information management information 700.
  • the shooting information management information 700 stores information about the shot image and the conditions at the time of shooting, and has a shooting information ID 711, a shooting information name 712, a shooting position 713, a shooting direction 714, and a shooting angle 715.
  • Information such as shooting procedure 716, shooting distance 717, shooting location 718, shooting date and time 719, shooting setting 721, shooting brightness 722, image 723, shooting condition 724, shooting condition determination 725, and the like are stored.
  • the shooting position, shooting direction, shooting angle, shooting distance, etc. may fluctuate during shooting (during sensor exposure). It is desirable to store the average value together, and if it fluctuates further, it is desirable to store the average value.
  • the shooting information ID 711 is identification information that uniquely identifies the shot image or the like.
  • the shooting information name 712 stores the name so that it can be easily understood when displaying the shooting information.
  • the photographing position 713 stores the position coordinates at which the image was taken, for example, the position information about the field specified by the field ID, the latitude, the longitude, the height information from the ground surface, and the like.
  • the shooting direction 714 stores the shooting direction.
  • the shooting angle 715 stores the shooting angle.
  • the shooting procedure 716 indicates the distance from the crop or the ground surface at the time of shooting.
  • the shooting location 718 indicates the location (shooting location) of the subject on which the shooting was performed. For example, the stock origin, the tip of the ear, etc. can be specified.
  • the shooting date and time 719 stores the date and time when the shooting was performed.
  • the shooting setting 721 stores image acquisition setting information such as an exposure setting at the time of shooting, the number of pixels, and a histogram adjustment value.
  • the shooting brightness 722 stores information on the brightness at the time of shooting.
  • the image 723 shows a link to the captured image information and the image information preprocessed by the mobile terminal 102 after the capture.
  • the shooting condition 724 stores the shooting condition management information 600 corresponding to the shot image, and the condition ID 611 of the shooting condition management information 600 is referred to.
  • the shooting condition determination 725 is information for storing whether or not the shooting condition is satisfied at the time of shooting.
  • the information of the shooting determination 1630 of FIG. 16 is stored.
  • FIG. 8 is an example of the growth state management information 800.
  • the growth state management information 800 stores the growth state of the crop obtained by analyzing the photography information management information 700, and stores information such as the growth state ID 811, the photography information ID 812, and the growth state 813.
  • the growth state ID 811 is information that uniquely identifies the growth state.
  • the shooting information ID 812 indicates the original data used for determining the growth state, and the value of the shooting information ID 711 of the shooting information management information 700 is stored.
  • the growth state 813 stores information regarding the analyzed growth state determination result.
  • FIG. 9 is an example of the shooting information acquisition processing flow 900.
  • the shooting information acquisition processing flow 900 is a process in which the shooting information management module 411 of the management server 103 receives and stores shooting information including images of crops from the mobile terminal 102.
  • the shooting information management module 411 receives shooting information including image information from the mobile terminal 102 (step 910).
  • the shooting information management module 411 stores the received shooting information in the shooting information management information 700 (step 920).
  • the shooting information received from the mobile terminal 102 includes information about shooting conditions such as stored in the shooting information management information 700, such as a shooting position, a shooting direction, and a shooting angle. Information such as shooting procedure, shooting distance, shooting location, shooting date and time, shooting settings, and brightness at the time of shooting is included. Information about these conditions is acquired by various sensors included in the mobile terminal 102. Further, as described above, when the mobile terminal 102 is a combination of the camera device 20 and a device such as a smartphone, information on the conditions at the time of shooting is acquired by either the camera device 20 or the device such as a smartphone. , Collectively, or separately sent to the management server 103. When the shooting information management module 411 receives the image and the information about the conditions at the time of shooting separately, the shooting information management module 411 stores them in the shooting information management information 700 in association with each other.
  • FIG. 10 is an example of the growth state determination processing flow 1000.
  • the growth state determination processing flow 1000 is a process in which the growth state management module 412 of the management server 103 analyzes the shooting information management information 700 such as an image to determine the growth state of the crop.
  • the growth state management module 412 receives from the mobile terminal 102 and reads out and acquires the shooting information management information 700 stored in the auxiliary storage device 402 (step 1010). It should be noted that the information received directly from the mobile terminal 102 may be acquired without being stored in the auxiliary storage device 402.
  • the growth state management module 412 analyzes various shooting information in the acquired shooting information management information 700 and determines the growth state of the crop (step 1020).
  • the growth state management module 412 stores the determined growth state and the analyzed photographed information in the growth state management information 800 (step 1030).
  • the shooting information management information 700 is associated with the growth state management information 800 by the shooting information ID 812, and the shooting condition 724 indicating the shooting condition management information 600 referred to at the time of shooting in the shooting information management information 700 and the shooting conditions thereof are satisfied.
  • the shooting condition determination 725 of whether or not the image was taken is stored.
  • For the analysis of the growth state for example, it is determined whether the crop is growing smoothly based on the color and length of the leaves, stems, ears, etc.
  • the growth state may be determined by calculating the growth degree of the crop by calculating the normalized difference vegetation index based on the ratio of the visible light region red light and the near infrared light of the leaves.
  • FIG. 11 is an example of the shooting condition calculation processing flow 1100.
  • the shooting condition calculation processing flow 1100 is a process in which the shooting condition management module 413 of the management server 103 calculates the shooting conditions of the image used for determining the growth state.
  • the photographing condition management module 413 acquires the growth state management information 800 and / or related information (step 1110).
  • the shooting condition management module 413 calculates shooting conditions based on the acquired information (step 1120).
  • the shooting condition management module 413 stores the calculated shooting conditions in the shooting condition management information 600 (step 1130).
  • the shooting condition management module 413 transmits the shooting condition management information 600 to the mobile terminal 102 (step 1140).
  • the imaging conditions to be calculated for example, information on the position coordinates for imaging, for example, the latitude, longitude, and height from the ground surface of a specific field is calculated.
  • the position coordinates and the number of the plurality of positions to be photographed are calculated based on at least one of the determination result of the growth state, the topographical information, and the soil information obtained by the past photographing.
  • the topographical information is information on the topography of the field such as the position of the floodgate and the position of the sun and shade at a specific date and time. These information can be calculated based on the field position 511 and the field surrounding coordinates 512 of the map information 400 and the field management information 500, and can be confirmed in advance by surveying or the like.
  • These terrain information are stored in the terrain information 514 of the field management information 500, and the shooting condition management module 413 acquires this terrain information and uses it for calculating the shooting conditions.
  • the soil information is, for example, detection information of soil components. These information are acquired, for example, based on the detection of soil components in the field, and are stored in the soil information 515 of the field management information 500.
  • the shooting condition management module 413 acquires this soil information and uses it for calculating the shooting conditions.
  • the number is determined from external information such as topographical information and soil condition, and a large number of shooting positions is set.
  • the imaging position and the number are determined based on the determination result of the growth state based on the previously captured image.
  • the Nth determination method is determined based on the determination result of the growth state based on the previously captured images in addition to the external information, but the number of imaging positions is reduced every time the number of imagings is passed to save labor. For example, if the shooting position has the same or similar tendency of the determination result and the external information, the shooting position is reduced at the next shooting. When a plurality of fields are targeted, the number of fields to be photographed can be reduced. That is, when the change in the growth state of the crop obtained by the past multiple shootings at the same shooting position is equal to or less than a predetermined value, the information regarding the same shooting position is not output as the shooting condition. On the contrary, when the symptoms of crop diseases appear, for example, when lesions occur, the number of shooting positions is increased, and when the growth changes occur, for example, important aspects such as heading, the number of shooting positions is increased. Let me.
  • the shooting direction is calculated based on at least one of, for example, the crop strip, the direction of sunlight at the time of shooting, and the shooting direction of past shooting.
  • the direction of the crop strip is stored in the planted crop 516 of the field management information 500, and the direction of sunlight (direction of forward light or back light) can be calculated from the map information 400 and the field management information 500.
  • the past shooting directions are stored in the shooting information management information 700, and the shooting condition management module 413 acquires these information and uses them for calculating the shooting conditions. For example, as a shooting condition, a shooting direction that is close to the shooting at the same position in the past is calculated and set in the direction along the crop line and in the direction of normal light.
  • the shooting angle is calculated based on the past shooting angle and a predetermined angle of 5 degrees ( ⁇ 2 degrees). For example, the same shooting angle as the previous shooting is set.
  • a shooting procedure is calculated based on past shooting information and a determination result of a growing state. For example, if a symptom of a disease is found in the previous shooting, the shooting procedure for shooting in the order of the plant root, stem, leaf, and tip is calculated.
  • Other shooting conditions include the distance to the subject and the distance related to the subject, such as the distance to the crop (distance to the crop) and the distance from the ground surface, based on past shooting information and the judgment result of the growing condition. Is calculated.
  • a shooting location indicating the location of the subject to be shot is calculated based on the past shooting information, the determination result of the growth state, the shooting time, and the growing time of the crop. For example, based on the shooting time, the leaf portion can be set as the imaging location when the disease is prevalent, and the tip portion can be set as the imaging location when the heading occurs.
  • the shooting location (shooting location) for the crop to be photographed is determined or calculated based on the past growth history information of the crop or the date and time.
  • the shooting time is calculated based on the past shooting information, the judgment result of the growth state, and the growth phase of the crop. For example, the time of photography is set based on the time when the disease is prevalent and the tendency of changes in the past growth state.
  • FIG. 12 is an example of the shooting condition display and the shooting processing flow 1200.
  • the shooting condition display and shooting processing flow 1200 is a process of displaying the shooting condition management information 600 transmitted from the management server 103 on the display unit of the mobile terminal 102 and performing shooting.
  • the shooting management module 213 of the mobile terminal 102 acquires the shooting condition management information 600 (step 1210). That is, the shooting management module 213 receives the shooting condition management information 600 from the management server 103, or reads the shooting condition management information 600 stored in the auxiliary storage device 202 after the reception.
  • the shooting management module 213 displays the shooting conditions acquired on the output device 205 such as a touch panel (step 1220).
  • FIG. 13 is an example of the shooting schedule information display screen 1300 displayed on the mobile terminal 102.
  • a shooting schedule list 1310 is displayed on the shooting schedule information display screen 1300, and each schedule is based on the information of the field name and the shooting time 619 corresponding to the plurality of shooting positions 613 described in the shooting condition management information 600.
  • a list of field names 1312 to be photographed in 1311 is displayed.
  • a plurality of fields 1302, 1303, and 1304 are displayed in the map information 1301, and in this example, the field A1302 is highlighted as a shooting condition on the day of May 10.
  • An anchor 1305 is described in each field, and position information such as the latitude and longitude of the field is associated with the anchor.
  • the shooting schedule information display screen 1300 also has a compass 1361 indicating the direction, a button 1362 for displaying the entire field in a wide area, a current location button 1363, and a schedule display button 1370. When the schedule display button 1370 is tapped while viewing the map information, the shooting schedule list 1310 is displayed.
  • FIG. 14 is an example of the shooting position list display screen 1400 displayed on the mobile terminal 102.
  • the condition title 1421 and the shooting position list information 1422 are displayed on the shooting position list display screen 1400, and an icon 1431 indicating the shooting position is displayed at the coordinate position corresponding to each shooting position of the shooting position list information 1422.
  • the shooting position list information 1422 displays the recommended shooting order together with the coordinate information of the shooting position.
  • the display position coordinates 1442 displays the position coordinates which are the latitude and longitude of the central portion of the screen, and when the current location button 1441 is tapped, the map information is updated so that the current position comes to the center of the screen.
  • FIG. 15 is an example of the shooting position detail display screen 1500 displayed on the mobile terminal 102.
  • the shooting position detail display screen 1500 is a display example when the fifth position coordinate 1531 is selected after displaying a list of shooting locations of the field A1510 similar to FIG. 14 for the field A1510 shown in the condition title 1521. be.
  • a shooting condition list 1522 at the time of shooting at the 5th position coordinate is displayed.
  • the shooting management module 213 of the mobile terminal 102 generates the display screens of FIGS. 13 to 15 based on various information stored in the acquired shooting condition management information 600.
  • the shooting management module 213 accepts the selection of shooting conditions for shooting (step 1230).
  • the shooting management module 213 executes shooting (step 1260).
  • a shooting instruction is displayed or announced on the mobile terminal to shoot, and when it is detected that the shooting button is selected, shooting is executed. You may do it. If the mode is not the automatic shooting mode, step 1240 is not executed and the process proceeds to the next step 1250.
  • step 1260 Even if the shooting conditions do not match, if the shooting button 1611 is tapped (step 1250 is Yes), the shooting management module 213 executes shooting (step 1260). At the time of shooting, the shooting conditions and the actual shooting conditions at the time of shooting are stored in the shooting information management information 700 in association with the image (step 1260).
  • the following various variations can be considered for automatic shooting.
  • -The camera automatically executes shooting when it is determined that at least a part of the shooting conditions is satisfied.
  • a button for prompting the photographer to shoot and a display such as shooting conditions are output.
  • the camera automatically executes shooting, and when the shooting conditions are not met, a button to prompt the photographer to shoot and a display of shooting conditions, etc. are displayed. Output.
  • step 1270 After executing the shooting, it is determined whether the actual shooting condition and the shooting conditions match, and if they match, the process is terminated as if the shooting end instruction was received (step 1270).
  • the shooting position, shooting direction, shooting angle, shooting distance, etc. may change during shooting (during sensor exposure), so these are the actual shooting conditions. Determine if the average value of the information matches the shooting conditions.
  • an allowable fluctuation amount (variation) as a shooting condition, it can be determined that the shooting condition is not satisfied when camera shake or the like occurs during shooting. If it is determined that the shooting conditions do not satisfy the shooting conditions due to camera shake or the like, the process returns to step 1240 and reshooting is performed.
  • step 1240 If the shooting conditions and shooting conditions match in step 1240 (Yes in step 1240) and the shooting management module 213 executes shooting (step 1260), the shooting conditions and shooting conditions in step 1270. It is not necessary to determine whether and are in agreement. Further, in step 1270, when the photographer individually receives a shooting end instruction such as turning off the camera switch, the process ends without determining whether the shooting status and the shooting conditions match. You may do it.
  • a shooting end instruction such as turning off the camera switch
  • FIG. 16 is an example of a screen 1600 at the time of shooting by the mobile terminal 102.
  • the shooting management module 213 accepts the selection of shooting conditions, the display is switched to the shooting screen 1600.
  • the GPS function of the mobile terminal 102 may be configured to automatically select the shooting conditions at the shooting position and display the shooting screen 1600 when approaching the shooting position.
  • the shooting screen 1600 On the shooting screen 1600, the crop 1610 of the subject captured by the camera unit 206 of the mobile terminal 102 is displayed, and the condition title 1621 and the shooting condition list 1622 are displayed in front of the crop 1610.
  • the shooting condition list 1622 has a determination column 1630, and the shooting management module 213 determines whether or not the input information from the input device 204 such as the camera unit 206 of the mobile terminal 102 or various sensors satisfies various conditions. Display the result. By looking at this judgment column, the field manager can take a picture while checking how well the conditions are met.
  • the shooting button 1611 When the shooting button 1611 is selected, shooting is performed and an image is acquired. At this time, the determination result of the imaging condition list 1622 and the determination column 1630 and the actual imaging setting at the time of imaging are stored in association with the image. That is, the shooting button 1611 is a display for executing shooting regardless of whether or not at least a part of the shooting conditions is satisfied. It should be noted that the display is not limited to the button, and may be any display that accepts shooting instructions.
  • shooting button 1612 When the automatic shooting button 1612 is selected, shooting is automatically performed and an image is acquired when all the judgment results in the judgment column 1630 are rounded, that is, when all the shooting conditions match the shooting conditions. It should be noted that the image is not saved only when all the conditions are satisfied, but the image may be acquired when a certain ratio is satisfied, for example, 80%, or some settings may be made. The image may be acquired when only a specific item is circled.
  • the mobile terminal 102 can determine whether or not the shooting conditions calculated by the management server 103 are satisfied at the time of shooting, and the image satisfying the shooting conditions can be acquired. Therefore, the image is executed by the management server 103. It is possible to take and acquire a more suitable image for determining the growth state of the crop to be produced.
  • a series of work procedures can be displayed in the shooting condition list 1622 as a shooting procedure, and it is possible to encourage the photographer to shoot according to this procedure.
  • the shooting procedure include taking a picture of the sky light and then taking a picture of the crop, or taking a picture of the plant root, the whole, and the tip of the ear in that order.
  • the work procedure for this is displayed as a shooting condition, and a moving image confirming that this work procedure has been carried out in sequence. You can check the work by taking a picture or taking a picture.
  • work instruction information not limited to shooting may be displayed. For example, when it is determined that the growth state of the crop obtained by the past photographing shows a sign of the disease, the work instruction information for treating the disease can be displayed.
  • the growth state management information 800 of the management server 103 analyzes the shooting information such as an image received from the mobile terminal 102 to determine the growth state, and shoots based on the determination result of the growth state.
  • the configuration in which the condition management module 413 calculates the shooting condition management information 600 has been described, the configuration may be such that the determination of the growth state and the calculation of the shooting conditions are performed by the mobile terminal 102.
  • the growth state management module 212 of the mobile terminal 102 may determine the growth state, and the mobile terminal 102 may be provided with a shooting condition management module for calculating shooting conditions.
  • the device for determining the growth state of the crop in this embodiment may be called a growth management device.
  • the growth management device is the management server 103 arranged on the cloud
  • the output destination of the information regarding the shooting conditions is the mobile terminal 102 connected by the network, and when the growth management device is the mobile terminal 102.
  • the output destination of the information regarding the shooting conditions is the display unit provided in the mobile terminal.
  • the shooting position list information 1422 in FIG. 14 a plurality of shooting positions of the field are displayed on the map to indicate the shooting order, and the field manager directs the mobile terminal 102 toward the place. Get a photo by.
  • the photographing management module 213 of the mobile terminal 102 may provide a navigation function for guiding the field manager to the photographing position.
  • the shooting position where shooting is completed is displayed in a different color from the non-shooting position, so that the position where shooting is completed and the position where shooting is not completed are distinguished. It may be displayed. With this function, the photographer can easily grasp which shooting position to go to next.
  • the flight path management module of the management server 103 calculates the flight path of the drone 101 based on the shooting position and the shooting time calculated by the shooting condition management module 413, and the flight controller 501 of the drone 101. It may be configured to shoot while flying the drone based on the calculated flight path.
  • the present invention is not limited to the above-described embodiment, but includes various modifications.
  • the above-described embodiment has been described in detail in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the one including all the described configurations.
  • it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment and it is also possible to add the configuration of another embodiment to the configuration of one embodiment.
  • each of the above configurations, functions, processing units, processing means, etc. may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be placed in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.
  • SSD Solid State Drive
  • control lines and information lines indicate those that are considered necessary for explanation, and do not necessarily indicate all the control lines and information lines in the product. In practice, it can be considered that almost all configurations are interconnected. It should be noted that the above-mentioned embodiment discloses at least the configuration described in the claims.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Primary Health Care (AREA)
  • Tourism & Hospitality (AREA)
  • Mining & Mineral Resources (AREA)
  • Animal Husbandry (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Agronomy & Crop Science (AREA)
  • Strategic Management (AREA)
  • Marine Sciences & Fisheries (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Botany (AREA)
  • Ecology (AREA)
  • Forests & Forestry (AREA)
  • Environmental Sciences (AREA)
  • Studio Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Provided is a system for acquiring an image that is more suitable for determining a crop growth state. The present invention provides a crop growth management device having: an acquisition unit that acquires image information captured by a camera; a determination unit that determines a crop growth state on the basis of the acquired image information; and an output unit that outputs information, wherein the output unit outputs information related to the image-capturing condition for determining the crop growth state.

Description

作物の生育管理装置及び生育管理方法Crop growth management device and growth management method
　本発明は、作物の生育管理装置及び生育管理方法に関する。 The present invention relates to a crop growth management device and a growth management method.
　本技術分野の背景技術として、特開２００７－１２４９３２号公報（特許文献１）がある。この公報には、「コンピュータ３は、通信部と、画像に基づいて生育情報を生成する生育情報生成部と、識別情報に対応する携帯型通信端末装置に、生育情報生成部が生成した生育情報を通信部を介して送信して、携帯型通信端末装置２の表示部に生育情報を表示させる情報提供部を有する。携帯型通信端末装置２は、表示部２５と、通信部と、フィルタと、被計測対象の植物の反射光をフィルタを介して撮影して画像を取得する撮影部２１と、分光画像、識別情報を関連付けて通信部を介してコンピュータ３に送信し、コンピュータ３から受信した被計測対象の植物Ｐ１の生育情報や生育診断情報を表示部２５に表
示させる制御回路とを有する」と記載されている（要約参照）。 As a background technique in this technical field, there is Japanese Patent Application Laid-Open No. 2007-124932 (Patent Document 1). In this publication, "The computer 3 has a communication unit, a growth information generation unit that generates growth information based on an image, and a portable communication terminal device that corresponds to the identification information, and the growth information generated by the growth information generation unit. The portable communication terminal device 2 has an information providing unit for displaying growth information on the display unit of the portable communication terminal device 2. The portable communication terminal device 2 includes a display unit 25, a communication unit, and a filter. , The photographing unit 21 that acquires an image by photographing the reflected light of the plant to be measured through a filter, and the spectral image and the identification information are associated with each other and transmitted to the computer 3 via the communication unit and received from the computer 3. It has a control circuit for displaying the growth information and growth diagnosis information of the plant P1 to be measured on the display unit 25 "(see summary).
特開２００７－１２４９３２号公報Japanese Unexamined Patent Publication No. 2007-124932
　前記特許文献１には、携帯型通信端末装置で撮影した画像に基づいて、生育診断を行うシステムが記載されている。しかしながら、本特許文献１は携帯型通信端末装置から送信された画像情報をコンピュータで解析するのみで、作物の生育状態を判定するために適した撮影条件については考慮がされていなかった。
　そこで、本発明は、作物の生育状態を判定するためにより適した画像を取得するための仕組みを提供する。 The patent document 1 describes a system for performing a growth diagnosis based on an image taken by a portable communication terminal device. However, in Patent Document 1, only the image information transmitted from the portable communication terminal device is analyzed by a computer, and the imaging conditions suitable for determining the growth state of the crop are not considered.
Therefore, the present invention provides a mechanism for acquiring a more suitable image for determining the growth state of a crop.
　上記課題を解決するために、例えば特許請求の範囲に記載の構成を採用する。
　本願は上記課題を解決する手段を複数含んでいるが、その一例を挙げるならば、カメラにより撮影された画像情報を取得する取得部と、取得した画像情報に基づいて作物の生育状態を判定する判定部と、情報を出力する出力部と、を有する作物の生育管理装置であって、前記出力部は、前記作物の生育状態を判定するための撮影条件に関する情報を出力することを特徴とする。 In order to solve the above problems, for example, the configuration described in the claims is adopted.
The present application includes a plurality of means for solving the above-mentioned problems. For example, an acquisition unit for acquiring image information taken by a camera and a crop growth state are determined based on the acquired image information. A crop growth management device having a determination unit and an output unit for outputting information, wherein the output unit outputs information regarding imaging conditions for determining the growth state of the crop. ..
　本発明によれば、作物の生育状態を判定するためにより適した画像を取得するための仕組みを提供することができる。
　上で説明した以外の課題、構成及び効果は、以下の実施形態の説明により明らかにされる。 According to the present invention, it is possible to provide a mechanism for acquiring a more suitable image for determining the growth state of a crop.
Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.
作物の生育管理システム１００全体の接続構成図の例である。This is an example of a connection configuration diagram of the entire crop growth management system 100. モバイル端末１０２のハードウェア構成の例である。This is an example of the hardware configuration of the mobile terminal 102. モバイル端末１０２の別のハードウェア構成の例である。This is an example of another hardware configuration of the mobile terminal 102. 管理サーバ１０３のハードウェア構成の例である。This is an example of the hardware configuration of the management server 103. 圃場管理情報５００の例である。This is an example of field management information 500. 撮影条件管理情報６００の例である。This is an example of shooting condition management information 600. 撮影情報管理情報７００の例である。This is an example of shooting information management information 700. 生育状態管理情報８００の例である。This is an example of growth state management information 800. 撮影情報取得処理フロー９００の例である。This is an example of the shooting information acquisition processing flow 900. 生育状態判定処理フロー１０００の例である。This is an example of the growth state determination processing flow 1000. 撮影条件算出処理フロー１１００の例である。This is an example of the shooting condition calculation processing flow 1100. 撮影条件表示及び撮影処理フロー１２００の例である。This is an example of the shooting condition display and the shooting processing flow 1200. モバイル端末１０２に表示される撮影スケジュール情報表示画面１３００の例である。This is an example of the shooting schedule information display screen 1300 displayed on the mobile terminal 102. モバイル端末１０２に表示される撮影位置一覧表示画面１４００の例である。This is an example of the shooting position list display screen 1400 displayed on the mobile terminal 102. モバイル端末１０２に表示される撮影位置詳細表示画面１５００の例である。This is an example of the shooting position detail display screen 1500 displayed on the mobile terminal 102. モバイル端末１０２による撮影時画面１６００の例である。This is an example of the screen 1600 at the time of shooting by the mobile terminal 102.
　以下、実施例を図面を用いて説明する。
　カメラ装置やスマートフォンやタブレット端末などのモバイル端末を用いて植物などの作物を撮影し、撮影した画像を解析して、作物の生育診断を行うことを想定する。
　図１は、作物の生育管理システム１００全体の接続構成図の例である。
　生育管理システム１００は、ドローン１０１、モバイル端末１０２、基地局１１０を備え、それぞれがネットワークを介して管理サーバ１０３に接続されている。なお、ネットワークは有線、無線を問わず、それぞれの端末はネットワークを介して情報を送受信することができる。 Hereinafter, examples will be described with reference to the drawings.
It is assumed that crops such as plants are photographed using a camera device or a mobile terminal such as a smartphone or tablet terminal, and the captured images are analyzed to perform a crop growth diagnosis.
FIG. 1 is an example of a connection configuration diagram of the entire crop growth management system 100.
The growth management system 100 includes a drone 101, a mobile terminal 102, and a base station 110, each of which is connected to the management server 103 via a network. The network may be wired or wireless, and each terminal can send and receive information via the network.
　ネットワークは１つの通信規格により通信するネットワークでもよいし、複数の通信規格網が組み合わされたネットワークであってもよい。例えば、ドローン１０１とモバイル端末１０２はそれぞれ基地局１１０が提供するＷｉ－Ｆｉ（登録商標）によりネットワーク接続されてもよいし、ドローン１０１とモバイル端末１０２はそれぞれＬＴＥ等の携帯通信網によりネットワーク接続されてもよい。また、ドローン１０１が基地局１１０により提供されるＷｉ－Ｆｉにより接続され、基地局１１０とモバイル端末１０２は携帯通信網により接続される構成としてもよい。 The network may be a network that communicates according to one communication standard, or may be a network that is a combination of a plurality of communication standard networks. For example, the drone 101 and the mobile terminal 102 may be network-connected by Wi-Fi (registered trademark) provided by the base station 110, respectively, and the drone 101 and the mobile terminal 102 may be network-connected by a mobile communication network such as LTE, respectively. You may. Further, the drone 101 may be connected by Wi-Fi provided by the base station 110, and the base station 110 and the mobile terminal 102 may be connected by a mobile communication network.
　モバイル端末１０２は例えばカメラを有するタブレット端末やスマートフォン等の携帯情報機器や、通信機能を有するカメラ装置によって実現される。
　モバイル端末１０２により撮影された作物の画像もしくは当該画像がモバイル端末で処理された処理データがネットワークを介して管理サーバ１０３に送信され、管理サーバ１０３により作物の生育診断を実行する。
　ドローン１０１は管理サーバ１０３からの指示若しくはモバイル端末１０２により自律飛行を行なうが、モバイル端末１０２によりマニュアル操作を行うことができる。モバイル端末１０２は、基地局１１０と接続されており、基地局１１０を介して、若しくは直接管理サーバ１０３と通信を行うことができる。 The mobile terminal 102 is realized by, for example, a portable information device such as a tablet terminal or a smartphone having a camera, or a camera device having a communication function.
The image of the crop taken by the mobile terminal 102 or the processing data obtained by processing the image by the mobile terminal is transmitted to the management server 103 via the network, and the management server 103 executes the crop growth diagnosis.
The drone 101 performs autonomous flight by an instruction from the management server 103 or by the mobile terminal 102, but can be manually operated by the mobile terminal 102. The mobile terminal 102 is connected to the base station 110, and can communicate with the management server 103 directly or via the base station 110.
　管理サーバ１０３は、例えばクラウド上に配置されたサーバであり、モバイル端末１０２やドローン１０１に搭載されたカメラや各種センサから送信された画像やセンサ情報を解析することで圃場や作物の状態等の様々な分析を行うことができる。
　基地局１１０は、圃場１２０に設置され、Ｗｉ－Ｆｉ通信の親機機能等を提供する装置であり、ＲＴＫ－ＧＰＳ基地局としても機能し、ドローン１０１の正確な位置を提供できるようになっている（Ｗｉ－Ｆｉ通信の親機機能とＲＴＫ－ＧＰＳ基地局が独立した装置であってもよい）。また、基地局１１０は、３Ｇ、４Ｇ、およびＬＴＥ等の携帯通信網を用いて、管理サーバ１０３と通信可能である。 The management server 103 is, for example, a server arranged on the cloud, and analyzes images and sensor information transmitted from cameras and various sensors mounted on the mobile terminal 102 and the drone 101 to determine the state of fields and crops. Various analyzes can be performed.
The base station 110 is a device installed in the field 120 and providing a master unit function for Wi-Fi communication, and also functions as an RTK-GPS base station, so that the accurate position of the drone 101 can be provided. (The base unit function of Wi-Fi communication and the RTK-GPS base station may be independent devices). Further, the base station 110 can communicate with the management server 103 using a mobile communication network such as 3G, 4G, and LTE.
　作物の生育管理システム１００のそれぞれの端末や管理サーバ１０３は、例えば、スマートフォン、タブレット、携帯電話機、携帯情報端末（ＰＤＡ）などの携帯端末（モバイル端末）でもよいし、メガネ型や腕時計型、着衣型などのウェアラブル端末でもよい。また、据置型または携帯型のコンピュータや、クラウドやネットワーク上に配置されるサーバでもよい。また、機能としてはＶＲ（仮想現実：Virtual Reality）端末、ＡＲ（拡張現実：Augmented Reality）端末、ＭＲ（複合現実：Mixed Reality）端末でもよい。あるいは、これらの複数の端末の組合せであってもよい。例えば、１台のスマートフォンと１台のウェアラブル端末との組合せが論理的に一つの端末として機能し得る。またこれら以外の情報処理端末であってもよい。 Each terminal or management server 103 of the crop growth management system 100 may be a mobile terminal (mobile terminal) such as a smartphone, a tablet, a mobile phone, or a mobile information terminal (PDA), or may be a glasses type, a wristwatch type, or a clothing type. It may be a wearable terminal such as a type. It may also be a stationary or portable computer, or a server located in the cloud or on a network. Further, the function may be a VR (Virtual Reality) terminal, an AR (Augmented Reality) terminal, or an MR (Mixed Reality) terminal. Alternatively, it may be a combination of these plurality of terminals. For example, a combination of one smartphone and one wearable terminal can logically function as one terminal. Further, it may be an information processing terminal other than these.
　生育管理システム１００のそれぞれの端末や管理サーバ１０３は、それぞれオペレーティングシステムやアプリケーション、プログラムなどを実行するプロセッサ（制御部）と、ＲＡＭ（Random Access Memory）等の主記憶装置と、ＩＣカードやハードディスクドライブ、ＳＳＤ（Solid State Drive）、フラッシュメモリ等の補助記憶装置と、ネットワークカードや無線通信モジュール、モバイル通信モジュール等の通信制御部と、タッチパネルやキーボード、マウス、音声入力、カメラ部の撮像による動き検知による入力などの入力装置と、モニタやディスプレイ等の出力装置とを備える。なお、出力装置は、外部のモニタやディスプレイ、プリンタ、機器などに、出力するための情報を送信する装置や端子であってもよい。 Each terminal and management server 103 of the growth management system 100 has a processor (control unit) that executes an operating system, an application, a program, etc., a main storage device such as a RAM (RandomAccessMemory), and an IC card or a hard disk drive. , SSD (Solid State Drive), auxiliary storage device such as flash memory, communication control unit such as network card, wireless communication module, mobile communication module, touch panel, keyboard, mouse, voice input, motion detection by imaging of camera unit It is equipped with an input device such as an input device and an output device such as a monitor and a display. The output device may be a device or a terminal for transmitting information for output to an external monitor, display, printer, device, or the like.
　主記憶装置には、各種プログラムやアプリケーションなど（モジュール）が記憶されており、これらのプログラムやアプリケーションをプロセッサが実行することで全体システムの各機能要素が実現される。なお、これらの各モジュールは集積化する等によりハードウェアで実装してもよい。また、各モジュールはそれぞれ独立したプログラムやアプリケーションでもよいが、１つの統合プログラムやアプリケーションの中の一部のサブプログラムや関数などの形で実装されていてもよい。 Various programs and applications (modules) are stored in the main memory, and each functional element of the entire system is realized by the processor executing these programs and applications. In addition, each of these modules may be implemented by hardware by integrating them. Further, each module may be an independent program or application, but may be implemented in the form of a part of a subprogram or a function in one integrated program or application.
　本明細書では、各モジュールが、処理を行う主体（主語）として記載をしているが、実際には各種プログラムやアプリケーションなど（モジュール）を処理するプロセッサが処理を実行する。
　補助記憶装置には、各種データベース（ＤＢ）が記憶されている。「データベース」とは、プロセッサまたは外部のコンピュータからの任意のデータ操作（例えば、抽出、追加、削除、上書きなど）に対応できるようにデータ集合を記憶する機能要素（記憶部）である。データベースの実装方法は限定されず、例えばデータベース管理システムでもよいし、表計算ソフトウェアでもよいし、ＸＭＬ、ＪＳＯＮなどのテキストファイルでもよい。
　本実施例における生育管理の仕組みは、生育管理システム１００において管理サーバ１０３がモバイル端末１０２と連携して実施することもできるし、モバイル端末１０２単体で実施することもできる。従って管理サーバ１０３を生育管理装置と呼ぶこともあるし、モバイル端末１０２を生育管理装置と呼ぶこともある。 In this specification, each module is described as a subject (subject) that performs processing, but in reality, a processor that processes various programs, applications, etc. (module) executes processing.
Various databases (DBs) are stored in the auxiliary storage device. A "database" is a functional element (storage unit) that stores a data set so that it can handle arbitrary data operations (for example, extraction, addition, deletion, overwriting, etc.) from a processor or an external computer. The method of implementing the database is not limited, and may be, for example, a database management system, spreadsheet software, or a text file such as XML or JSON.
The growth management mechanism in this embodiment can be implemented by the management server 103 in cooperation with the mobile terminal 102 in the growth management system 100, or can be implemented by the mobile terminal 102 alone. Therefore, the management server 103 may be referred to as a growth management device, and the mobile terminal 102 may be referred to as a growth management device.
　図２は、モバイル端末１０２のハードウェア構成の例である。
　モバイル端末１０２は、例えばタブレットやスマートフォン、ヘッドマウントディスプレイ、カメラ等の端末である。
　主記憶装置２０１には、撮影情報管理モジュール２１１、生育状態管理モジュール２１２、撮影管理モジュール２１３等のプログラムやアプリケーションが記憶されており、これらのプログラムやアプリケーションをプロセッサ２０３が実行することでモバイル端末１０２の各機能要素が実現される。
　撮影情報管理モジュール２１１は、カメラ部２０６により撮影された画像情報や各種センサ等の入力装置２０４により取得された圃場や作物に関する情報を管理し、撮影情報管理情報７００に記憶する。またこれらの記憶された情報を管理サーバ１０３に送信する。 FIG. 2 is an example of the hardware configuration of the mobile terminal 102.
The mobile terminal 102 is, for example, a terminal such as a tablet, a smartphone, a head-mounted display, or a camera.
Programs and applications such as a shooting information management module 211, a growth state management module 212, and a shooting management module 213 are stored in the main storage device 201, and the processor 203 executes these programs and applications to carry out the mobile terminal 102. Each functional element of is realized.
The photographing information management module 211 manages the image information photographed by the camera unit 206 and the information regarding the fields and crops acquired by the input device 204 such as various sensors, and stores the information in the photographing information management information 700. Further, these stored information is transmitted to the management server 103.
　生育状態管理モジュール２１２は、管理サーバ１０３から受信した作物の生育診断情報等の生育状態管理情報８００をモニタやパネルなどの出力装置２０５に表示する。
　また、モバイル端末１０２単体で画像を分析し生育診断する構成の場合には、生育状態管理モジュール２１２が画像を分析し、作物の生育状態を判定し、生育診断情報等の生育状態管理情報８００を算出する。
　撮影管理モジュール２１３は、管理サーバ１０３から送信された撮影条件管理情報６００に記載された撮影条件を表示し、条件に一致する写真画像を撮影する。
　補助記憶装置２０２は、画面に表示する地図の情報が記憶されている地図情報４００、圃場管理情報５００、撮影条件管理情報６００、撮影情報管理情報７００、生育状態管理情報８００等の各種情報を記憶する。 The growth state management module 212 displays the growth state management information 800 such as the growth diagnosis information of the crop received from the management server 103 on the output device 205 such as a monitor or a panel.
Further, in the case of a configuration in which the image is analyzed and the growth diagnosis is performed by the mobile terminal 102 alone, the growth state management module 212 analyzes the image, determines the growth state of the crop, and obtains the growth state management information 800 such as the growth diagnosis information. calculate.
The shooting management module 213 displays the shooting conditions described in the shooting condition management information 600 transmitted from the management server 103, and shoots a photographic image that matches the conditions.
The auxiliary storage device 202 stores various information such as map information 400 in which map information to be displayed on the screen is stored, field management information 500, shooting condition management information 600, shooting information management information 700, and growth state management information 800. do.
　図３は、モバイル端末１０２の別のハードウェア構成の例である。
　例えば、モバイル端末１０２は、一眼レフカメラやコンパクトカメラなどの通信機能を備えたカメラ装置２０である。カメラ装置２０は、レンズと撮像部を備えるカメラ部２１を有する。
　また、カメラ装置２０は、カメラ部２１の全体的な制御を行うカメラコントローラー（カメラ制御部）２２を有し、カメラ部２１に対して撮影の指示などを行うカメラキャプチャ２３などを有する。
　また、カメラ装置２０は、カメラ部の撮影した画像を前処理する画像処理部（イメージ・プロセッサ）２４を有する。
　また、カメラ装置２０は、ＳＳＤ等の記憶装置２５を有し、撮影した画像または前処理後の画像のデータなどを記憶することができる。 FIG. 3 is an example of another hardware configuration of the mobile terminal 102.
For example, the mobile terminal 102 is a camera device 20 having a communication function such as a single-lens reflex camera or a compact camera. The camera device 20 has a camera unit 21 including a lens and an image pickup unit.
Further, the camera device 20 has a camera controller (camera control unit) 22 that controls the entire camera unit 21, and has a camera capture 23 that gives an instruction for shooting to the camera unit 21.
Further, the camera device 20 has an image processing unit (image processor) 24 that preprocesses the image captured by the camera unit.
Further, the camera device 20 has a storage device 25 such as an SSD, and can store captured images, preprocessed image data, and the like.
　カメラ装置２０は、さらに、伝送装置２６を有し、撮影した画像の生データまたは前処理後の画像のデータ等を外部の管理サーバ１０３などに伝送することができる。
　例えば、遠隔地間のファイルやディレクトリの同期を行うアプリケーションソフトウェア２７などを利用して、管理サーバ１０３等のクラウド装置２８などに接続することができる。
　さらに、カメラ装置２０は、ドローン１０１に搭載することも可能であり、ドローン１０１と接続する接続部を備えることもできる。カメラ装置２０は、ドローン１０１の製造時に搭載されてもよく、ドローン１０１に対して後付けで搭載されてもよい。 The camera device 20 also has a transmission device 26, and can transmit raw data of captured images, data of preprocessed images, and the like to an external management server 103 and the like.
For example, it is possible to connect to a cloud device 28 such as a management server 103 by using application software 27 or the like that synchronizes files and directories between remote locations.
Further, the camera device 20 can be mounted on the drone 101, and can also be provided with a connection portion for connecting to the drone 101. The camera device 20 may be mounted at the time of manufacturing the drone 101, or may be mounted after the drone 101.
　カメラ装置２０をドローン１０１に搭載した場合には、フライトコントローラー５０１と接続し、撮影した画像などのデータをフライトコントローラー５０１に伝送することができる。また、フライトコントローラー５０１と連携し、ドローン１０１の飛行中に撮影を行うこともできる。
　カメラ装置２０は、ドローン１０１の位置、速度、姿勢、時間、飛行状況（ミッション状況）、対地高度などの情報をフライトコントローラー５０１から受信することができる。また、フライトコントローラー５０１からの指示に応じてカメラ部により撮影処理を実行することができる。
　なお、カメラ部は通常の可視光カメラの他、赤外光カメラ、紫外光カメラ、複数波長を取得可能なマルチスペクトルカメラであってもよい。 When the camera device 20 is mounted on the drone 101, it can be connected to the flight controller 501 and data such as captured images can be transmitted to the flight controller 501. In addition, in cooperation with the flight controller 501, it is possible to take a picture during the flight of the drone 101.
The camera device 20 can receive information such as the position, speed, attitude, time, flight status (mission status), and altitude above ground level of the drone 101 from the flight controller 501. Further, the camera unit can execute the shooting process according to the instruction from the flight controller 501.
The camera unit may be an infrared light camera, an ultraviolet light camera, or a multispectral camera capable of acquiring a plurality of wavelengths, in addition to a normal visible light camera.
　図４は、管理サーバ１０３のハードウェア構成の例である。
　管理サーバ１０３は、例えばクラウド上に配置されたサーバで構成される。
　主記憶装置４０１には、撮影情報管理モジュール４１１、生育状態管理モジュール４１２、撮影条件管理モジュール４１３等のプログラムやアプリケーションが記憶されており、これらのプログラムやアプリケーションをプロセッサ４０３が実行することで管理サーバ１０３の各機能要素が実現される。
　撮影情報管理モジュール４１１は、モバイル端末１０２のカメラ部２０６により撮影された画像情報や、各種センサ等の入力装置２０４により取得された圃場や作物に関する情報、をモバイル端末１０２から受信し、撮影情報管理情報７００に記憶し管理する。 FIG. 4 is an example of the hardware configuration of the management server 103.
The management server 103 is composed of, for example, a server arranged on the cloud.
Programs and applications such as a shooting information management module 411, a growth state management module 412, and a shooting condition management module 413 are stored in the main storage device 401, and a management server is executed by the processor 403 executing these programs and applications. Each functional element of 103 is realized.
The shooting information management module 411 receives image information taken by the camera unit 206 of the mobile terminal 102 and information about fields and crops acquired by the input device 204 such as various sensors from the mobile terminal 102, and manages the shooting information. It is stored and managed in the information 700.
　生育状態管理モジュール４１２は、モバイル端末１０２から受信した圃場や作物に関する画像や情報を分析し、作物の生育状態を判定する。生育状態管理モジュール４１２は、生育状態の判定結果を生育状態管理情報８００として補助記憶装置４０２に記憶し、また画像等の情報を送付してきたモバイル端末１０２に送付する。
　撮影条件管理モジュール４１３は、生育状態を判定するために使用する画像の撮影条件を算出し、管理する。
　補助記憶装置４０２は、地図情報４００、圃場管理情報５００、撮影条件管理情報６００、撮影情報管理情報７００、生育状態管理情報８００等の各種情報を記憶する。 The growth state management module 412 analyzes images and information about fields and crops received from the mobile terminal 102, and determines the growth state of the crop. The growth state management module 412 stores the growth state determination result as the growth state management information 800 in the auxiliary storage device 402, and also sends the information such as an image to the mobile terminal 102 that has sent the information.
The photographing condition management module 413 calculates and manages the photographing conditions of the image used for determining the growth state.
The auxiliary storage device 402 stores various information such as map information 400, field management information 500, imaging condition management information 600, imaging information management information 700, and growth state management information 800.
　なお、モバイル端末１０２と管理サーバ１０３で同じ情報が記憶されているが、これはそれぞれの情報が同期されてもよいし、単に一方の情報を他方がコピーする構成でも構わない。また一部または全ての情報を管理サーバ１０３上に記憶しておき、モバイル端末１０２からは必要に応じて管理サーバ１０３から情報をダウンロードする構成であっても構わない。 Although the same information is stored in the mobile terminal 102 and the management server 103, the respective information may be synchronized with each other, or one of the information may be simply copied by the other. Further, a configuration may be configured in which some or all of the information is stored in the management server 103, and the information is downloaded from the management server 103 from the mobile terminal 102 as needed.
　また、カメラ装置２０とスマートフォンなどの機器が連携することで１体としてモバイル端末１０２を形成する構成であってもよい。この場合、カメラ装置２０自体が携帯電話データ通信網による通信機能を有していない場合であっても、カメラ装置２０から画像等の情報をスマートフォンに転送し、スマートフォンの通信機能を介して管理サーバ１０３に画像等の撮影情報を送信することが可能となる。
　また、逆にカメラ装置２０が位置情報や方位情報等を取得するセンサを有していない場合であっても、スマートフォンが有するＧＰＳ機能や電子コンパスによる方位計測機能により取得された情報を活用し、カメラ装置２０が、これらの情報と関連付けて画像を記憶・送信することができる。 Further, the camera device 20 and a device such as a smartphone may be linked to form the mobile terminal 102 as one body. In this case, even if the camera device 20 itself does not have a communication function by the mobile phone data communication network, information such as an image is transferred from the camera device 20 to the smartphone and the management server is transferred via the communication function of the smartphone. It is possible to transmit shooting information such as an image to 103.
On the contrary, even if the camera device 20 does not have a sensor for acquiring position information, orientation information, etc., the information acquired by the GPS function of the smartphone or the orientation measurement function by the electronic compass can be utilized. The camera device 20 can store and transmit an image in association with such information.
　例えば、以下のような処理が実行される。
　カメラ装置２０は、撮影した画像を画像処理部２４で処理し、処理後の画像情報を無線または有線ネットワークによりスマートフォンに送信する。
　スマートフォンは、受信した処理後画像を表示すると共に、画像情報とスマートフォンで取得した位置情報等(ＧＰＳ位置情報、撮影の向き、対象物からの距離等)を対応つけて、管理サーバ１０３に送信する。
　管理サーバ１０３は、受信した画像情報と位置情報に基づいて作物の生育状態を分析・診断し、生育状態の判定結果（生育診断結果）をスマートフォンに送信する。
　スマートフォンは、管理サーバ１０３から受信した生育診断結果を表示する。 For example, the following processing is executed.
The camera device 20 processes the captured image in the image processing unit 24, and transmits the processed image information to the smartphone via a wireless or wired network.
The smartphone displays the received processed image, associates the image information with the position information acquired by the smartphone (GPS position information, shooting direction, distance from the object, etc.), and transmits the image information to the management server 103. ..
The management server 103 analyzes and diagnoses the growth state of the crop based on the received image information and position information, and transmits the determination result (growth diagnosis result) of the growth state to the smartphone.
The smartphone displays the growth diagnosis result received from the management server 103.
　別の連携方法としては、例えば、スマートフォンがＧＰＳ機能により取得された位置情報をカメラ装置２０に送信し、カメラ装置２０が処理画像と位置情報とを管理サーバ１０３に送信する。受信した画像情報と位置情報に基づいて作物の生育状態を分析・診断し、生育状態の判定結果（生育診断結果）をスマートフォン又はカメラ装置２０に送信する。
　別の連携方法としては、例えば、カメラ装置２０が処理画像を管理サーバ１０３に送信し、スマートフォンが位置情報を管理サーバ１０３にし、管理サーバ１０３側でこれらの情報を対応付けた後、受信した画像情報と位置情報に基づいて作物の生育状態を分析・診断し、生育状態の判定結果（生育診断結果）をスマートフォン又はカメラ装置２０に送信する。 As another cooperation method, for example, the smartphone transmits the position information acquired by the GPS function to the camera device 20, and the camera device 20 transmits the processed image and the position information to the management server 103. The growth state of the crop is analyzed and diagnosed based on the received image information and position information, and the determination result (growth diagnosis result) of the growth state is transmitted to the smartphone or the camera device 20.
As another cooperation method, for example, the camera device 20 sends the processed image to the management server 103, the smartphone sets the location information to the management server 103, the management server 103 associates these information, and then the received image. The growth state of the crop is analyzed and diagnosed based on the information and the position information, and the determination result (growth diagnosis result) of the growth state is transmitted to the smartphone or the camera device 20.
　図５は、圃場管理情報５００の例である。
　圃場管理情報５００は、作物の生育状態判定を行う作物が育てられている圃場に関する各種情報を記憶しており、圃場ＩＤ、圃場名、圃場位置５１１、圃場周囲座標５１２、圃場面積５１３、地形情報５１４、土壌情報５１５、作付作物５１６等の情報を記憶する。圃場管理情報５００を単に圃場情報と呼ぶこともある。
　圃場ＩＤは、圃場を一意に特定する識別情報である。
　圃場位置５１１は、圃場の位置座標を示し、例えば圃場の中心の緯度・経度の情報を有する。
　圃場周囲座標５１２は、圃場の周囲の座標を示し、例えば４角形の圃場であれば角の４点の位置座標である。サンプル値のＧＣ００７は、位置座標が連続してカンマ区切りなどで記憶された情報へのリンクを示す。 FIG. 5 is an example of the field management information 500.
The field management information 500 stores various information about the field in which the crop for determining the growth state of the crop is grown, and includes the field ID, the field name, the field position 511, the field surrounding coordinates 512, the field area 513, and the topographical information. Information such as 514, soil information 515, and cultivated crop 516 is stored. The field management information 500 may be simply referred to as field information.
The field ID is identification information that uniquely identifies the field.
The field position 511 indicates the position coordinates of the field, and has, for example, information on the latitude and longitude of the center of the field.
The field circumference coordinate 512 indicates the coordinates around the field, and is, for example, the position coordinates of the four corners in the case of a quadrangular field. The sample value GC007 indicates a link to information in which the position coordinates are continuously stored separated by commas or the like.
　圃場面積５１３は、圃場ＩＤに対応する圃場の総面積である。
　地形情報５１４は、例えば水門の位置や特定の日時における日向・日陰の位置等の圃場の地形に関する情報である。これらの情報は、地図情報４００及び圃場管理情報５００の圃場位置５１１や圃場周囲座標５１２に基づいて算出することが可能であり、また予め測量等により確認された情報が記憶されている。
　土壌情報５１５は、圃場の土壌に関する情報へのリンクを示す。土壌に関する情報とは、例えば土壌成分の検出情報等である。
　作付作物５１６は、圃場に作付けされている作物等を特定する情報を示す。また、作物の作付の情報、例えば作物の条の向きや一般的な生育の過程などに関する情報も記憶されている。 The field area 513 is the total area of the field corresponding to the field ID.
The topographical information 514 is information on the topography of the field such as the position of the floodgate and the position of the sun and shade at a specific date and time. These information can be calculated based on the field position 511 and the field surrounding coordinates 512 of the map information 400 and the field management information 500, and the information confirmed in advance by surveying or the like is stored.
Soil information 515 provides a link to information about the soil in the field. The information about soil is, for example, detection information of soil components.
The cultivated crop 516 shows information for identifying the crop or the like cultivated in the field. In addition, information on crop planting, such as the orientation of crop strips and general growth processes, is also stored.
　図６は、撮影条件管理情報６００の例である。
　撮影条件管理情報６００は、作物や圃場の撮影を行う場合の条件を記憶しており、条件ＩＤ６１１、条件名６１２、撮影位置６１３、撮影の方位６１４、撮影の角度６１５、撮影手順６１６、撮影距離６１７、撮影箇所６１８、撮影時期６１９、撮影設定６２１等の情報を記憶する。
　条件ＩＤ６１１は、条件を一意に特定する識別情報である。
　条件名６１２は、条件を表示する際に分かり易いように名称を記憶する。
　撮影位置６１３は、撮影を行う位置座標、例えば圃場ＩＤで特定される圃場についての位置情報、緯度、経度、地表からの高さ情報等を記憶する。撮影位置６１３に記載された例「farm007-360613.58926, 1400516.27816-80cm」は、圃場ＩＤがfarm007の圃場について、緯度36度06分13.58926秒、経度140度05分16.27816秒、地表からの高さ80cmの位置であることを示す。
　撮影の方位６１４は、撮影を行う方位を記憶する。撮影の方位６１４に記載された例「270」は北から時計回りに270度、すなわち真西向きであることを示す。 FIG. 6 is an example of the shooting condition management information 600.
The shooting condition management information 600 stores conditions for shooting crops and fields, and condition ID 611, condition name 612, shooting position 613, shooting direction 614, shooting angle 615, shooting procedure 616, and shooting distance. Information such as 617, shooting location 618, shooting time 619, shooting setting 621, etc. is stored.
The condition ID 611 is identification information that uniquely identifies the condition.
The condition name 612 stores the name so that it can be easily understood when displaying the condition.
The shooting position 613 stores position coordinates for shooting, for example, position information about the field specified by the field ID, latitude, longitude, height information from the ground surface, and the like. The example "farm007-360613.58926, 1400516.27816-80cm" described in the shooting position 613 has a latitude of 36 degrees 06 minutes 13.58926 seconds, a longitude of 140 degrees 05 minutes 16.27816 seconds, and a height of 80 cm from the ground surface for a field with a field ID of farm007. Indicates a position.
The shooting direction 614 stores the shooting direction. The example "270" described in the shooting direction 614 indicates that the direction is 270 degrees clockwise from the north, that is, facing the true west.
　撮影の角度６１５は、撮影を行う角度を記憶する。例えば水平方向を０として上向きに正、下向きに負の角度を使用し、撮影の角度６１５に記載された例「-30」は水平方向から下向きに３０度の方向であることを示す。
　撮影手順６１６は、撮影を行う際の手順が記憶されている。この撮影手順をモバイル端末１０２に表示することで、この手順に従った撮影を撮影者に促すことが可能となる。撮影手順の例としては、天空光を撮影してから作物を撮影することや、株元、全体、穂先の順に撮影すること、が挙げられる。
　撮影距離６１７は、撮影を行う際の作物や地表からの距離を示す。
　撮影箇所６１８は、撮影を行う被写体の場所（撮影個所）を示す。例えば株元や穂先等が指定できる。
　撮影時期６１９は、撮影を行う日にちや時間を記憶する。撮影時期６１９に記載された例「0810-0820」は８月１０日から８月２０日の間に撮影を行うことを示している。期間ではなく特定の日時を設定することもできる。
　撮影設定６２１は、撮影を行う際の画像取得の設定情報を記憶する。例えばシャッタースピードや絞り値等の露出設定、画素数、ヒストグラム調整等が記憶される。 The shooting angle 615 stores the shooting angle. For example, with the horizontal direction as 0, a positive angle upward and a negative angle downward are used, and the example "-30" described in the shooting angle 615 indicates a direction of 30 degrees downward from the horizontal direction.
In the shooting procedure 616, a procedure for performing shooting is stored. By displaying this shooting procedure on the mobile terminal 102, it is possible to encourage the photographer to shoot according to this procedure. Examples of the shooting procedure include taking a picture of the sky light and then taking a picture of the crop, or taking a picture of the plant root, the whole, and the tip of the ear in that order.
The shooting distance 617 indicates the distance from the crop or the ground surface when shooting.
The shooting location 618 indicates a location (shooting location) of the subject to be photographed. For example, the stock origin, the tip of the ear, etc. can be specified.
The shooting time 619 stores the date and time of shooting. The example "0810-0820" described in the shooting time 619 indicates that shooting is performed between August 10th and August 20th. You can also set a specific date and time instead of a period.
The shooting setting 621 stores image acquisition setting information when shooting. For example, exposure settings such as shutter speed and aperture value, number of pixels, histogram adjustment, etc. are stored.
　図７は、撮影情報管理情報７００の例である。
　撮影情報管理情報７００は、撮影された画像や撮影された際の条件についての情報を記憶しており、撮影情報ＩＤ７１１、撮影情報名７１２、撮影位置７１３、撮影の方位７１４、撮影の角度７１５、撮影手順７１６、撮影距離７１７、撮影箇所７１８、撮影日時７１９、撮影設定７２１、撮影時輝度７２２、画像７２３、撮影条件７２４、撮影条件判定７２５等の情報を記憶する。ここで、人が手に持って撮影を行うため、撮影位置、撮影方位、撮影角度、撮影距離などは、撮影中（センサー露光中）に変動することが考えられるため、これら情報については変動量も併せて記憶することが望ましく、更に変動する場合には平均値を記憶することが望ましい。 FIG. 7 is an example of the shooting information management information 700.
The shooting information management information 700 stores information about the shot image and the conditions at the time of shooting, and has a shooting information ID 711, a shooting information name 712, a shooting position 713, a shooting direction 714, and a shooting angle 715. Information such as shooting procedure 716, shooting distance 717, shooting location 718, shooting date and time 719, shooting setting 721, shooting brightness 722, image 723, shooting condition 724, shooting condition determination 725, and the like are stored. Here, since a person holds the image in his / her hand for shooting, the shooting position, shooting direction, shooting angle, shooting distance, etc. may fluctuate during shooting (during sensor exposure). It is desirable to store the average value together, and if it fluctuates further, it is desirable to store the average value.
　撮影情報ＩＤ７１１は、撮影された画像等を一意に特定する識別情報である。
　撮影情報名７１２は、撮影情報を表示する際に分かり易いように名称を記憶する。
　撮影位置７１３は、撮影を行った位置座標、例えば圃場ＩＤで特定される圃場についての位置情報、緯度、経度、地表からの高さ情報等を記憶する。
　撮影の方位７１４は、撮影を行った方位を記憶する。
　撮影の角度７１５は、撮影を行った角度を記憶する。
　撮影手順７１６は、撮影を行った際の手順が記憶されている。
　撮影距離７１７は、撮影を行った際の作物や地表からの距離を示す。
　撮影箇所７１８は、撮影を行った被写体の場所（撮影個所）を示す。例えば株元や穂先等が指定できる。 The shooting information ID 711 is identification information that uniquely identifies the shot image or the like.
The shooting information name 712 stores the name so that it can be easily understood when displaying the shooting information.
The photographing position 713 stores the position coordinates at which the image was taken, for example, the position information about the field specified by the field ID, the latitude, the longitude, the height information from the ground surface, and the like.
The shooting direction 714 stores the shooting direction.
The shooting angle 715 stores the shooting angle.
In the shooting procedure 716, the procedure at the time of shooting is stored.
The shooting distance 717 indicates the distance from the crop or the ground surface at the time of shooting.
The shooting location 718 indicates the location (shooting location) of the subject on which the shooting was performed. For example, the stock origin, the tip of the ear, etc. can be specified.
　撮影日時７１９は、撮影を行った日時を記憶する。
　撮影設定７２１は、撮影時の露出設定や画素数、ヒストグラム調整値等の画像取得設定情報を記憶する。
　撮影時輝度７２２は、撮影を行った際の輝度の情報を記憶する。
　画像７２３は、撮影された画像情報や、撮影後にモバイル端末１０２で前処理された画像情報に対するリンクを示す。
　撮影条件７２４は、撮影された画像に対応する撮影条件管理情報６００を記憶し、撮影条件管理情報６００の条件ＩＤ６１１が参照される。
　撮影条件判定７２５は、撮影の際に、撮影条件が満たされたかどうかを記憶する情報である。図１６の撮影時判定１６３０の情報が記憶される。 The shooting date and time 719 stores the date and time when the shooting was performed.
The shooting setting 721 stores image acquisition setting information such as an exposure setting at the time of shooting, the number of pixels, and a histogram adjustment value.
The shooting brightness 722 stores information on the brightness at the time of shooting.
The image 723 shows a link to the captured image information and the image information preprocessed by the mobile terminal 102 after the capture.
The shooting condition 724 stores the shooting condition management information 600 corresponding to the shot image, and the condition ID 611 of the shooting condition management information 600 is referred to.
The shooting condition determination 725 is information for storing whether or not the shooting condition is satisfied at the time of shooting. The information of the shooting determination 1630 of FIG. 16 is stored.
　図８は、生育状態管理情報８００の例である。
　生育状態管理情報８００は、撮影情報管理情報７００を分析することにより求められる作物の生育状態を記憶しており、生育状態ＩＤ８１１、撮影情報ＩＤ８１２、生育状態８１３等の情報を記憶する。
　生育状態ＩＤ８１１は、生育状態を一意に特定する情報である。
　撮影情報ＩＤ８１２は、生育状態の判定のために用いられた元データを示し、撮影情報管理情報７００の撮影情報ＩＤ７１１の値が記憶される。
　生育状態８１３は、分析された生育状態の判定結果に関する情報を記憶する。 FIG. 8 is an example of the growth state management information 800.
The growth state management information 800 stores the growth state of the crop obtained by analyzing the photography information management information 700, and stores information such as the growth state ID 811, the photography information ID 812, and the growth state 813.
The growth state ID 811 is information that uniquely identifies the growth state.
The shooting information ID 812 indicates the original data used for determining the growth state, and the value of the shooting information ID 711 of the shooting information management information 700 is stored.
The growth state 813 stores information regarding the analyzed growth state determination result.
　図９は、撮影情報取得処理フロー９００の例である。
　撮影情報取得処理フロー９００は、管理サーバ１０３の撮影情報管理モジュール４１１がモバイル端末１０２から作物の画像を含む撮影情報を受信し記憶する処理である。
　撮影情報管理モジュール４１１は、モバイル端末１０２から画像情報を含む撮影情報を受信する（ステップ９１０）。
　撮影情報管理モジュール４１１は、受信した撮影情報を撮影情報管理情報７００に記憶する（ステップ９２０）。 FIG. 9 is an example of the shooting information acquisition processing flow 900.
The shooting information acquisition processing flow 900 is a process in which the shooting information management module 411 of the management server 103 receives and stores shooting information including images of crops from the mobile terminal 102.
The shooting information management module 411 receives shooting information including image information from the mobile terminal 102 (step 910).
The shooting information management module 411 stores the received shooting information in the shooting information management information 700 (step 920).
　モバイル端末１０２から受信する撮影情報には、画像情報の他、撮影情報管理情報７００に記憶されるような撮影された際の条件についての情報である、撮影位置、撮影の方位、撮影の角度、撮影手順、撮影距離、撮影箇所、撮影日時、撮影設定、撮影時輝度等の情報が含まれる。これらの条件についての情報はモバイル端末１０２が備える各種センサにより取得される。
　また、前述のように、モバイル端末１０２がカメラ装置２０とスマートフォン等の機器の組み合わせの場合には、撮影された際の条件についての情報はカメラ装置２０とスマートフォン等の機器のいずれかが取得し、まとめられて、若しくはそれぞれ別に管理サーバ１０３に送信される。
　撮影情報管理モジュール４１１は、画像と、撮影された際の条件についての情報を別々に受信した場合には、それらを関連付けて撮影情報管理情報７００に記憶する。 In addition to the image information, the shooting information received from the mobile terminal 102 includes information about shooting conditions such as stored in the shooting information management information 700, such as a shooting position, a shooting direction, and a shooting angle. Information such as shooting procedure, shooting distance, shooting location, shooting date and time, shooting settings, and brightness at the time of shooting is included. Information about these conditions is acquired by various sensors included in the mobile terminal 102.
Further, as described above, when the mobile terminal 102 is a combination of the camera device 20 and a device such as a smartphone, information on the conditions at the time of shooting is acquired by either the camera device 20 or the device such as a smartphone. , Collectively, or separately sent to the management server 103.
When the shooting information management module 411 receives the image and the information about the conditions at the time of shooting separately, the shooting information management module 411 stores them in the shooting information management information 700 in association with each other.
　図１０は、生育状態判定処理フロー１０００の例である。
　生育状態判定処理フロー１０００は、管理サーバ１０３の生育状態管理モジュール４１２が画像等の撮影情報管理情報７００を分析して、作物の生育状態を判定する処理である。
　生育状態管理モジュール４１２は、モバイル端末１０２から受信し、補助記憶装置４０２に記憶されている撮影情報管理情報７００を読み出し、取得する（ステップ１０１０）。なお、補助記憶装置４０２に記憶せず、直接モバイル端末１０２から受信した情報を取得してもよい。 FIG. 10 is an example of the growth state determination processing flow 1000.
The growth state determination processing flow 1000 is a process in which the growth state management module 412 of the management server 103 analyzes the shooting information management information 700 such as an image to determine the growth state of the crop.
The growth state management module 412 receives from the mobile terminal 102 and reads out and acquires the shooting information management information 700 stored in the auxiliary storage device 402 (step 1010). It should be noted that the information received directly from the mobile terminal 102 may be acquired without being stored in the auxiliary storage device 402.
　生育状態管理モジュール４１２は、取得した撮影情報管理情報７００の中の各種撮影情報を分析し、作物の生育状態を判定する（ステップ１０２０）。
　生育状態管理モジュール４１２は、判定した生育状態と分析した撮影情報とを関連付けて生育状態管理情報８００に記憶する（ステップ１０３０）。生育状態管理情報８００には撮影情報ＩＤ８１２により撮影情報管理情報７００が関連付けられており、撮影情報管理情報７００の中で撮影時に参照した撮影条件管理情報６００を示す撮影条件７２４やその撮影条件を満たしたかどうかの撮影条件判定７２５が記憶されている。
　生育状態の分析としては、例えば撮影された画像情報の葉や茎や穂等の色や長さなどに基づいて作物が順調に成長しているかの判定や、病気の症状（例えば初期病斑）が出ていないかの判定が考えられる。また、葉の可視光域赤色光と近赤外光との比率に基づいて正規化差植生指数を算出することで作物の生育度合いを算出することにより、生育状態を判定してもよい。 The growth state management module 412 analyzes various shooting information in the acquired shooting information management information 700 and determines the growth state of the crop (step 1020).
The growth state management module 412 stores the determined growth state and the analyzed photographed information in the growth state management information 800 (step 1030). The shooting information management information 700 is associated with the growth state management information 800 by the shooting information ID 812, and the shooting condition 724 indicating the shooting condition management information 600 referred to at the time of shooting in the shooting information management information 700 and the shooting conditions thereof are satisfied. The shooting condition determination 725 of whether or not the image was taken is stored.
For the analysis of the growth state, for example, it is determined whether the crop is growing smoothly based on the color and length of the leaves, stems, ears, etc. of the photographed image information, and the symptoms of the disease (for example, initial lesions). It is conceivable to judge whether or not is displayed. Further, the growth state may be determined by calculating the growth degree of the crop by calculating the normalized difference vegetation index based on the ratio of the visible light region red light and the near infrared light of the leaves.
　図１１は、撮影条件算出処理フロー１１００の例である。
　撮影条件算出処理フロー１１００は、管理サーバ１０３の撮影条件管理モジュール４１３が、生育状態の判定に使用する画像の撮影条件を算出する処理である。
　撮影条件管理モジュール４１３は、生育状態管理情報８００及び/又は関連する情報を取得する（ステップ１１１０）。
　撮影条件管理モジュール４１３は、取得した情報に基づいて撮影条件を算出する（ステップ１１２０）。
　撮影条件管理モジュール４１３は、算出した撮影条件を撮影条件管理情報６００に記憶する（ステップ１１３０）。
　撮影条件管理モジュール４１３は、撮影条件管理情報６００をモバイル端末１０２に送信する（ステップ１１４０）。 FIG. 11 is an example of the shooting condition calculation processing flow 1100.
The shooting condition calculation processing flow 1100 is a process in which the shooting condition management module 413 of the management server 103 calculates the shooting conditions of the image used for determining the growth state.
The photographing condition management module 413 acquires the growth state management information 800 and / or related information (step 1110).
The shooting condition management module 413 calculates shooting conditions based on the acquired information (step 1120).
The shooting condition management module 413 stores the calculated shooting conditions in the shooting condition management information 600 (step 1130).
The shooting condition management module 413 transmits the shooting condition management information 600 to the mobile terminal 102 (step 1140).
　算出する撮影条件としては、例えば撮影を行う位置座標、例えば特定の圃場についての緯度、経度、地表からの高さの情報を算出する。撮影を行う複数の位置の位置座標や数は、過去の撮影により得られた生育状態の判定結果、地形情報、土壌情報の少なくともいずれかに基づいて算出される。
　地形情報は、例えば水門の位置や特定の日時における日向・日陰の位置等の圃場の地形に関する情報である。これらの情報は、地図情報４００及び圃場管理情報５００の圃場位置５１１や圃場周囲座標５１２に基づいて算出することが可能であり、また予め測量等により確認することが可能である。これらの地形情報は圃場管理情報５００の地形情報５１４に記憶されており、撮影条件管理モジュール４１３はこの地形情報を取得して撮影条件の算出に用いる。 As the imaging conditions to be calculated, for example, information on the position coordinates for imaging, for example, the latitude, longitude, and height from the ground surface of a specific field is calculated. The position coordinates and the number of the plurality of positions to be photographed are calculated based on at least one of the determination result of the growth state, the topographical information, and the soil information obtained by the past photographing.
The topographical information is information on the topography of the field such as the position of the floodgate and the position of the sun and shade at a specific date and time. These information can be calculated based on the field position 511 and the field surrounding coordinates 512 of the map information 400 and the field management information 500, and can be confirmed in advance by surveying or the like. These terrain information are stored in the terrain information 514 of the field management information 500, and the shooting condition management module 413 acquires this terrain information and uses it for calculating the shooting conditions.
　例えば、水門の開門により流れ込んだ水の影響で生育状態が変わる可能性があるため、水門の場所から一定の間隔で撮影位置を設けることができる。
　また、日向と日陰で撮影環境が変わるため、例えば撮影する際に必ず日向になる位置や必ず日陰になる位置を特定して撮影位置を設けることができる。
　土壌情報は、例えば土壌成分の検出情報等である。これらの情報は例えば圃場の土壌成分の検出に基づいて取得され、圃場管理情報５００の土壌情報５１５に記憶されている。撮影条件管理モジュール４１３は、この土壌情報を取得して撮影条件の算出に用いる。 For example, since the growth state may change due to the influence of the water flowing in due to the opening of the floodgate, it is possible to set shooting positions at regular intervals from the location of the floodgate.
Further, since the shooting environment changes depending on the sun and the shade, for example, when shooting, it is possible to specify the position where the sun is always and the position where the sun is always shaded and set the shooting position.
The soil information is, for example, detection information of soil components. These information are acquired, for example, based on the detection of soil components in the field, and are stored in the soil information 515 of the field management information 500. The shooting condition management module 413 acquires this soil information and uses it for calculating the shooting conditions.
　また、過去の撮影に基づく生育状態の変化に基づいて撮影の回数を増減させることが可能である。
　例えば、最初に撮影位置を決める際には、地形情報や土壌状態等の外部情報からその数を決定し、多めの撮影位置数を設定する。
　２回目の決め方は、外部情報に加え、前回の撮影画像による生育状態の判定結果に基づき、撮影位置と数を決定する。 In addition, it is possible to increase or decrease the number of photographs based on changes in the growth state based on past photographs.
For example, when first determining the shooting position, the number is determined from external information such as topographical information and soil condition, and a large number of shooting positions is set.
In the second determination method, in addition to external information, the imaging position and the number are determined based on the determination result of the growth state based on the previously captured image.
　Ｎ回目の決め方は、外部情報に加え、以前の撮影画像による生育状態の判定結果に基づいて決定するが、撮影回数を経る毎に撮影位置数を減らして省力化する。例えば、判定結果や外部情報の傾向が同じ若しくは類似した傾向のある撮影位置は、次回撮影時には撮影位置を削減する。複数の圃場が対象の場合には、撮影を行う対象の圃場の数を減らすこともできる。すなわち同一の撮影位置の過去の複数回の撮影により得られた作物の生育状態の変化が所定の値以下の場合には、同一の撮影位置に関する情報を撮影条件として出力しない。
　逆に、作物の病気の症状が現れた時、例えば病斑発生時、には撮影位置数を増加させたり、生育の変化が起こるタイミング、例えば出穂等の重要局面、には撮影位置数を増加させる。 The Nth determination method is determined based on the determination result of the growth state based on the previously captured images in addition to the external information, but the number of imaging positions is reduced every time the number of imagings is passed to save labor. For example, if the shooting position has the same or similar tendency of the determination result and the external information, the shooting position is reduced at the next shooting. When a plurality of fields are targeted, the number of fields to be photographed can be reduced. That is, when the change in the growth state of the crop obtained by the past multiple shootings at the same shooting position is equal to or less than a predetermined value, the information regarding the same shooting position is not output as the shooting condition.
On the contrary, when the symptoms of crop diseases appear, for example, when lesions occur, the number of shooting positions is increased, and when the growth changes occur, for example, important aspects such as heading, the number of shooting positions is increased. Let me.
　その他の撮影条件としては、例えば作物の条、撮影時の太陽光の向き、過去の撮影の撮影方位の少なくともいずれかに基づき、撮影の方位が算出される。
　作物の条の方向は、圃場管理情報５００の作付作物５１６に記憶されており、太陽光の向き（順光又は逆光の方向）は地図情報４００や圃場管理情報５００から算出することが可能であり、過去の撮影の方位は撮影情報管理情報７００に記憶されており、撮影条件管理モジュール４１３はこれらの情報を取得して撮影条件の算出に用いる。
　例えば、撮影条件として、作物の条に沿った方向で、順光になる方向で、過去の同一位置の撮影と近い方位の撮影方位が算出され設定される。 As other shooting conditions, the shooting direction is calculated based on at least one of, for example, the crop strip, the direction of sunlight at the time of shooting, and the shooting direction of past shooting.
The direction of the crop strip is stored in the planted crop 516 of the field management information 500, and the direction of sunlight (direction of forward light or back light) can be calculated from the map information 400 and the field management information 500. The past shooting directions are stored in the shooting information management information 700, and the shooting condition management module 413 acquires these information and uses them for calculating the shooting conditions.
For example, as a shooting condition, a shooting direction that is close to the shooting at the same position in the past is calculated and set in the direction along the crop line and in the direction of normal light.
　その他の撮影条件としては、例えば過去の撮影の角度や、所定の角度５度(±２度)に基づいて、撮影の角度が算出される。例えば、前回の撮影と同一の撮影の角度が設定される。
　その他の撮影条件としては、例えば過去の撮影情報や生育状態の判定結果に基づいて、撮影手順が算出される。例えば、前回の撮影で病気の症状が見つかった場合には、株元、茎、葉、穂先の順に撮影する撮影手順が算出される。 As other shooting conditions, for example, the shooting angle is calculated based on the past shooting angle and a predetermined angle of 5 degrees (± 2 degrees). For example, the same shooting angle as the previous shooting is set.
As other shooting conditions, for example, a shooting procedure is calculated based on past shooting information and a determination result of a growing state. For example, if a symptom of a disease is found in the previous shooting, the shooting procedure for shooting in the order of the plant root, stem, leaf, and tip is calculated.
　その他の撮影条件としては、過去の撮影情報や生育状態の判定結果に基づいて、作物との間の距離（作物に対する距離）や地表からの距離等の、被写体までの距離や被写体に関連する距離が算出される。
　その他の撮影条件としては、過去の撮影情報や生育状態の判定結果や撮影時期、作物の生育時期に基づいて、撮影を行う被写体の場所を示す撮影箇所が算出される。例えば、撮影時期に基づいて、病気が流行する時期には葉の箇所を、出穂する時期には穂先の箇所を、撮影箇所として設定することができる。
　また、その他、撮影する前記作物に対する撮影箇所（撮影個所）は、作物の過去の生育履歴情報、又は日時に基づいて判定又は算出される。 Other shooting conditions include the distance to the subject and the distance related to the subject, such as the distance to the crop (distance to the crop) and the distance from the ground surface, based on past shooting information and the judgment result of the growing condition. Is calculated.
As other shooting conditions, a shooting location indicating the location of the subject to be shot is calculated based on the past shooting information, the determination result of the growth state, the shooting time, and the growing time of the crop. For example, based on the shooting time, the leaf portion can be set as the imaging location when the disease is prevalent, and the tip portion can be set as the imaging location when the heading occurs.
In addition, the shooting location (shooting location) for the crop to be photographed is determined or calculated based on the past growth history information of the crop or the date and time.
　その他の撮影条件としては、過去の撮影情報や生育状態の判定結果や作物の生育フェーズに基づいて撮影時期が算出される。例えば、病気が流行する時期や過去の生育状態の変化傾向に基づいて撮影の時期が設定される。
　その他の撮影条件としては、過去の撮影情報や生育状態の判定結果や日照条件等に基づいて撮影設定を算出することとができる。例えば、前回の撮影設定と同じシャッタースピードや絞り値、画素数の撮影設定を算出する。
　以上説明した様々な撮影条件は全てを設定する必要はなく、これらを適宜組み合わせたものが撮影条件として設定される。 As other shooting conditions, the shooting time is calculated based on the past shooting information, the judgment result of the growth state, and the growth phase of the crop. For example, the time of photography is set based on the time when the disease is prevalent and the tendency of changes in the past growth state.
As other shooting conditions, it is possible to calculate the shooting settings based on the past shooting information, the determination result of the growth state, the sunshine condition, and the like. For example, the same shutter speed, aperture value, and number of pixels as the previous shooting settings are calculated.
It is not necessary to set all of the various shooting conditions described above, and a combination of these is set as the shooting conditions.
　図１２は、撮影条件表示及び撮影処理フロー１２００の例である。
　撮影条件表示及び撮影処理フロー１２００は、管理サーバ１０３から送信された撮影条件管理情報６００を、モバイル端末１０２の表示部などに表示し、撮影を行う処理である。
　モバイル端末１０２の撮影管理モジュール２１３は、撮影条件管理情報６００を取得する（ステップ１２１０）。すなわち、撮影管理モジュール２１３は、管理サーバ１０３から撮影条件管理情報６００を受信する、若しくは、受信後に補助記憶装置２０２に記憶されていた撮影条件管理情報６００を読み出す。
　撮影管理モジュール２１３は、タッチパネルなどの出力装置２０５に取得した撮影条件を表示する（ステップ１２２０）。 FIG. 12 is an example of the shooting condition display and the shooting processing flow 1200.
The shooting condition display and shooting processing flow 1200 is a process of displaying the shooting condition management information 600 transmitted from the management server 103 on the display unit of the mobile terminal 102 and performing shooting.
The shooting management module 213 of the mobile terminal 102 acquires the shooting condition management information 600 (step 1210). That is, the shooting management module 213 receives the shooting condition management information 600 from the management server 103, or reads the shooting condition management information 600 stored in the auxiliary storage device 202 after the reception.
The shooting management module 213 displays the shooting conditions acquired on the output device 205 such as a touch panel (step 1220).
　ここで、図１３～図１５を用いて、表示される撮影条件の例を説明する。
　図１３は、モバイル端末１０２に表示される撮影スケジュール情報表示画面１３００の例である。
　撮影スケジュール情報表示画面１３００には、撮影スケジュール一覧１３１０が表示されており、撮影条件管理情報６００に記載された複数の撮影位置６１３に対応する圃場名と撮影時期６１９の情報に基づいて、各日程１３１１における撮影する圃場名一覧１３１２が表示される。 Here, an example of the displayed shooting conditions will be described with reference to FIGS. 13 to 15.
FIG. 13 is an example of the shooting schedule information display screen 1300 displayed on the mobile terminal 102.
A shooting schedule list 1310 is displayed on the shooting schedule information display screen 1300, and each schedule is based on the information of the field name and the shooting time 619 corresponding to the plurality of shooting positions 613 described in the shooting condition management information 600. A list of field names 1312 to be photographed in 1311 is displayed.
　地図情報１３０１には複数の圃場１３０２、１３０３、１３０４が表示されており、この例では５月１０日当日の撮影条件として、圃場Ａ１３０２がハイライトされている。
　各圃場にはアンカー１３０５が記載され、圃場の緯度経度等の位置情報が関連付けられている。
　撮影スケジュール情報表示画面１３００は、その他、方位を示すコンパス１３６１、圃場全体を広域表示するボタン１３６２、現在地ボタン１３６３、スケジュール表示ボタン１３７０を有する。地図情報を閲覧している状態で、スケジュール表示ボタン１３７０がタップされると、撮影スケジュール一覧１３１０が表示される。 A plurality of fields 1302, 1303, and 1304 are displayed in the map information 1301, and in this example, the field A1302 is highlighted as a shooting condition on the day of May 10.
An anchor 1305 is described in each field, and position information such as the latitude and longitude of the field is associated with the anchor.
The shooting schedule information display screen 1300 also has a compass 1361 indicating the direction, a button 1362 for displaying the entire field in a wide area, a current location button 1363, and a schedule display button 1370. When the schedule display button 1370 is tapped while viewing the map information, the shooting schedule list 1310 is displayed.
　図１４は、モバイル端末１０２に表示される撮影位置一覧表示画面１４００の例である。
　撮影位置一覧表示画面１４００には、条件タイトル１４２１と撮影位置一覧情報１４２２が表示されており、撮影位置一覧情報１４２２のそれぞれの撮影位置に対応する座標位置に撮影位置を示すアイコン１４３１が表示されている。
　撮影位置一覧情報１４２２には、撮影する位置の座標情報と共に、推奨される撮影順序が表示されている。
　また、表示位置座標１４４２には、画面の中心部分の緯度経度である位置座標が表示され、現在地ボタン１４４１がタップされると、現在位置が画面の中心に来るように地図情報が更新される。 FIG. 14 is an example of the shooting position list display screen 1400 displayed on the mobile terminal 102.
The condition title 1421 and the shooting position list information 1422 are displayed on the shooting position list display screen 1400, and an icon 1431 indicating the shooting position is displayed at the coordinate position corresponding to each shooting position of the shooting position list information 1422. There is.
The shooting position list information 1422 displays the recommended shooting order together with the coordinate information of the shooting position.
Further, the display position coordinates 1442 displays the position coordinates which are the latitude and longitude of the central portion of the screen, and when the current location button 1441 is tapped, the map information is updated so that the current position comes to the center of the screen.
　図１５は、モバイル端末１０２に表示される撮影位置詳細表示画面１５００の例である。
　撮影位置詳細表示画面１５００は、条件タイトル１５２１に示された圃場Ａ１５１０について図１４と同様の圃場Ａ１５１０の撮影箇所一覧を表示した後、この５番の位置座標１５３１が選択された場合の表示例である。撮影位置詳細表示画面１５００には、５番の位置座標における撮影の際の撮影条件一覧１５２２が表示されている。
　以上説明したように、モバイル端末１０２の撮影管理モジュール２１３は、取得した撮影条件管理情報６００に記憶されている各種情報に基づいて、図１３～図１５の表示画面を生成する。 FIG. 15 is an example of the shooting position detail display screen 1500 displayed on the mobile terminal 102.
The shooting position detail display screen 1500 is a display example when the fifth position coordinate 1531 is selected after displaying a list of shooting locations of the field A1510 similar to FIG. 14 for the field A1510 shown in the condition title 1521. be. On the shooting position detail display screen 1500, a shooting condition list 1522 at the time of shooting at the 5th position coordinate is displayed.
As described above, the shooting management module 213 of the mobile terminal 102 generates the display screens of FIGS. 13 to 15 based on various information stored in the acquired shooting condition management information 600.
　再び図１２の撮影条件表示及び撮影処理フロー１２００に戻ると、撮影管理モジュール２１３は、撮影のために撮影条件の選択を受け付ける（ステップ１２３０）。
　自動撮影モードの場合には、撮影条件と撮影時の撮影状況が一致した場合（ステップ１２４０がＹｅｓ）に、撮影管理モジュール２１３が撮影を実行する（ステップ１２６０）。ここで、撮影条件と撮影時の撮影状況が一致した場合にモバイル端末に撮影を行うよう撮影指示を表示もしくはアナウンスを行い、撮影ボタンが選択されたことを検知した場合に、撮影を実行するようにしてもよい。
なお、自動撮影モードでない場合には、ステップ１２４０は実行されず次のステップ１２５０に移行する。
　また撮影条件が一致しない場合であっても、撮影ボタン１６１１がタップされた場合（ステップ１２５０がＹｅｓ）には、撮影管理モジュール２１３が撮影を実行する（ステップ１２６０）。
　撮影の際には、撮影条件、及び撮影時の実際の撮影状況を画像と関連付けて撮影情報管理情報７００に記憶する（ステップ１２６０）。 Returning to the shooting condition display and shooting processing flow 1200 of FIG. 12 again, the shooting management module 213 accepts the selection of shooting conditions for shooting (step 1230).
In the automatic shooting mode, when the shooting conditions and the shooting conditions at the time of shooting match (step 1240 is Yes), the shooting management module 213 executes shooting (step 1260). Here, when the shooting conditions and the shooting conditions at the time of shooting match, a shooting instruction is displayed or announced on the mobile terminal to shoot, and when it is detected that the shooting button is selected, shooting is executed. You may do it.
If the mode is not the automatic shooting mode, step 1240 is not executed and the process proceeds to the next step 1250.
Even if the shooting conditions do not match, if the shooting button 1611 is tapped (step 1250 is Yes), the shooting management module 213 executes shooting (step 1260).
At the time of shooting, the shooting conditions and the actual shooting conditions at the time of shooting are stored in the shooting information management information 700 in association with the image (step 1260).
　なお、自動撮影には、以下のような様々なバリエーションが考えられる。例えば、
・撮影条件の少なくとも一部が満たされたことを判定した場合に、カメラが自動的に撮影を実行する。
・撮影条件の少なくとも一部が満たされたことを判定した場合に、撮影者に撮影を促すボタンや撮影条件等の表示を出力する。
・撮影条件の少なくとも一部が満たされたことを判定した場合に、カメラが自動的に撮影を実行し、撮影条件が満たされない場合に、撮影者に撮影を促すボタンや撮影条件等の表示を出力する。 The following various variations can be considered for automatic shooting. for example,
-The camera automatically executes shooting when it is determined that at least a part of the shooting conditions is satisfied.
-When it is determined that at least a part of the shooting conditions is satisfied, a button for prompting the photographer to shoot and a display such as shooting conditions are output.
-When it is determined that at least a part of the shooting conditions are satisfied, the camera automatically executes shooting, and when the shooting conditions are not met, a button to prompt the photographer to shoot and a display of shooting conditions, etc. are displayed. Output.
　撮影を実行した後に、実際の撮影状況と撮影条件とが一致しているかを判定し、一致している場合には撮影終了指示を受け付けたものとして処理を終了する（ステップ１２７０）。人がモバイル端末を手に持って撮影を行う場合、撮影位置、撮影方位、撮影角度、撮影距離などは、撮影中（センサー露光中）に変動することが考えられるため、実際の撮影状況におけるこれら情報の平均値が撮影条件と一致しているかを判断する。更に撮影条件として許容できる変動量（ばらつき）も併せて設定しておくことで、撮影する際に手振れなどが発生した場合に、撮影条件を満たさないと判断することができる。手振れなどにより撮影状況が撮影条件を満たさないと判断した場合には、ステップ１２４０に戻って、再撮影を行う。 After executing the shooting, it is determined whether the actual shooting condition and the shooting conditions match, and if they match, the process is terminated as if the shooting end instruction was received (step 1270). When a person holds a mobile terminal in his hand and shoots, the shooting position, shooting direction, shooting angle, shooting distance, etc. may change during shooting (during sensor exposure), so these are the actual shooting conditions. Determine if the average value of the information matches the shooting conditions. Furthermore, by also setting an allowable fluctuation amount (variation) as a shooting condition, it can be determined that the shooting condition is not satisfied when camera shake or the like occurs during shooting. If it is determined that the shooting conditions do not satisfy the shooting conditions due to camera shake or the like, the process returns to step 1240 and reshooting is performed.
　なお、ステップ１２４０において、撮影状況と撮影条件が一致していることにより（ステップ１２４０がＹｅｓ）、撮影管理モジュール２１３が撮影を実行した場合には（ステップ１２６０）、ステップ１２７０において撮影状況と撮影条件とが一致しているかの判定は行わなくてもよい。
　また、ステップ１２７０において、撮影者がカメラのスイッチをオフにするなど、個別に撮影終了指示を受け付けた場合には、撮影状況と撮影条件とが一致しているかを判定することなく、処理を終了することとしてもよい。 If the shooting conditions and shooting conditions match in step 1240 (Yes in step 1240) and the shooting management module 213 executes shooting (step 1260), the shooting conditions and shooting conditions in step 1270. It is not necessary to determine whether and are in agreement.
Further, in step 1270, when the photographer individually receives a shooting end instruction such as turning off the camera switch, the process ends without determining whether the shooting status and the shooting conditions match. You may do it.
　図１６は、モバイル端末１０２による撮影時画面１６００の例である。
　撮影管理モジュール２１３は、撮影条件の選択を受け付けると表示を撮影時画面１６００に切り替える。この例では、撮影者が圃場Ａ１３０２の５番の撮影位置座標１５３１の近くに来た際に、この位置の撮影条件が選択された状態を示す。
　なお、モバイル端末１０２のＧＰＳ機能等により、撮影位置のそばに近づいた場合に、自動的のその位置の撮影条件が選択され、撮影時画面１６００が表示される構成としてもよい。 FIG. 16 is an example of a screen 1600 at the time of shooting by the mobile terminal 102.
When the shooting management module 213 accepts the selection of shooting conditions, the display is switched to the shooting screen 1600. In this example, when the photographer comes near the shooting position coordinate 1531 of the field A1302, the shooting condition of this position is selected.
It should be noted that the GPS function of the mobile terminal 102 may be configured to automatically select the shooting conditions at the shooting position and display the shooting screen 1600 when approaching the shooting position.
　撮影時画面１６００には、モバイル端末１０２のカメラ部２０６により撮像された被写体の作物１６１０が表示されており、その前面に条件タイトル１６２１及び撮影条件一覧１６２２が表示されている。
　撮影条件一覧１６２２には判定欄１６３０があり、モバイル端末１０２のカメラ部２０６や各種センサ等の入力装置２０４からの入力情報が、各種条件を満たしているかどうかを撮影管理モジュール２１３が判定し、その結果を表示する。圃場管理者はこの判定欄を見ることで、どれくらい条件を満たしているかを確認しながら写真の撮影を行うことができる。 On the shooting screen 1600, the crop 1610 of the subject captured by the camera unit 206 of the mobile terminal 102 is displayed, and the condition title 1621 and the shooting condition list 1622 are displayed in front of the crop 1610.
The shooting condition list 1622 has a determination column 1630, and the shooting management module 213 determines whether or not the input information from the input device 204 such as the camera unit 206 of the mobile terminal 102 or various sensors satisfies various conditions. Display the result. By looking at this judgment column, the field manager can take a picture while checking how well the conditions are met.
　撮影ボタン１６１１が選択されると、撮影が行われ画像が取得される。この際、撮影条件一覧１６２２及び判定欄１６３０の判定結果並びに撮影時の実際の撮影設定を画像と関連付けて記憶する。つまり、撮影ボタン１６１１は、撮影条件の少なくとも一部が満たされたか否かにかかわらず撮影を実行する表示である。なお、ボタンに限らず、撮影の指示を受け付けるあらゆる表示であって構わない。
　自動撮影ボタン１６１２が選択されると、判定欄１６３０の判定結果が全て丸になった場合、すなわちすべての撮影条件が撮影状況と一致した時に、自動的に撮影が行われ画像が取得される。
　なお、条件の全てが満たされた場合にのみ画像が保存されるのではなく、例えば８割など、一定の割合が満たされた場合に画像が取得される設定にしてもよいし、いくつかの特定の項目のみが丸となった場合に画像が取得される設定にしてもよい。 When the shooting button 1611 is selected, shooting is performed and an image is acquired. At this time, the determination result of the imaging condition list 1622 and the determination column 1630 and the actual imaging setting at the time of imaging are stored in association with the image. That is, the shooting button 1611 is a display for executing shooting regardless of whether or not at least a part of the shooting conditions is satisfied. It should be noted that the display is not limited to the button, and may be any display that accepts shooting instructions.
When the automatic shooting button 1612 is selected, shooting is automatically performed and an image is acquired when all the judgment results in the judgment column 1630 are rounded, that is, when all the shooting conditions match the shooting conditions.
It should be noted that the image is not saved only when all the conditions are satisfied, but the image may be acquired when a certain ratio is satisfied, for example, 80%, or some settings may be made. The image may be acquired when only a specific item is circled.
　また、条件が満たされた場合に画像を取得し記憶するのではなく、動画または一定時間間隔のコマ送り画像としてすべての画像を取得及び記憶しておき、条件が一致した画像に、条件が満たされた旨のフラグ付けを行い、後の処理で区別して使用できるようにする構成でもよい。または、撮影条件一覧１６２２の各条件を満たしているかどうかの判定欄１６３０の情報を、動画中の各画像と関連付けて記憶し、後の処理で条件を満たした画像を抽出する構成でもよい。
　このように、管理サーバ１０３で算出された撮影条件が撮影時に満たされているかどうかを、モバイル端末１０２で判定し、撮影条件が満たされた画像を取得することができるため、管理サーバ１０３で実行される作物の生育状態判定のためにより適した画像の撮影及び取得が可能となる。 Also, instead of acquiring and storing images when the conditions are met, all images are acquired and stored as moving images or frame-by-frame images at regular time intervals, and the conditions are satisfied for the images that match the conditions. It may be configured so that it can be used separately in the later processing by flagging it to the effect that it has been done. Alternatively, the information in the determination column 1630 for determining whether or not each condition in the shooting condition list 1622 may be satisfied may be stored in association with each image in the moving image, and the image satisfying the condition may be extracted in a later process.
In this way, the mobile terminal 102 can determine whether or not the shooting conditions calculated by the management server 103 are satisfied at the time of shooting, and the image satisfying the shooting conditions can be acquired. Therefore, the image is executed by the management server 103. It is possible to take and acquire a more suitable image for determining the growth state of the crop to be produced.
　なお、撮影条件一覧１６２２には、撮影手順として一連の作業手順を表示することができ、この手順に従った撮影を撮影者に促すことが可能となる。撮影手順の例としては、天空光を撮影してから作物を撮影することや、株元、全体、穂先の順に撮影すること、が挙げられる。
　例えば、撮影画像を管理サーバ１０３で生育状態判定した結果、初期病斑が検出された場合には、これに対する作業手順を撮影条件として表示し、この作業手順が順次実施されたことを確認する動画や写真を撮影することで、作業確認を行うことができる。
　さらに、撮影に限られない作業指示情報を表示することとしてもよい。例えば、過去の撮影により得られた作物の生育状態が病気の兆候を示していると判定された場合に、病気を治療するための作業指示情報を表示することもできる。 A series of work procedures can be displayed in the shooting condition list 1622 as a shooting procedure, and it is possible to encourage the photographer to shoot according to this procedure. Examples of the shooting procedure include taking a picture of the sky light and then taking a picture of the crop, or taking a picture of the plant root, the whole, and the tip of the ear in that order.
For example, if an initial lesion is detected as a result of determining the growth state of the captured image on the management server 103, the work procedure for this is displayed as a shooting condition, and a moving image confirming that this work procedure has been carried out in sequence. You can check the work by taking a picture or taking a picture.
Further, work instruction information not limited to shooting may be displayed. For example, when it is determined that the growth state of the crop obtained by the past photographing shows a sign of the disease, the work instruction information for treating the disease can be displayed.
　なお、上述の実施例では、管理サーバ１０３の生育状態管理情報８００がモバイル端末１０２から受信した画像等の撮影情報を分析して生育状態の判定を行い、この生育状態の判定結果に基づいて撮影条件管理モジュール４１３が撮影条件管理情報６００を算出する構成を説明したが、生育状態の判定と撮影条件の算出はモバイル端末１０２で実施する構成にしてもよい。この場合、モバイル端末１０２の生育状態管理モジュール２１２が生育状態の判定を行い、モバイル端末１０２に撮影条件を算出する撮影条件管理モジュールを設ければよい。 In the above embodiment, the growth state management information 800 of the management server 103 analyzes the shooting information such as an image received from the mobile terminal 102 to determine the growth state, and shoots based on the determination result of the growth state. Although the configuration in which the condition management module 413 calculates the shooting condition management information 600 has been described, the configuration may be such that the determination of the growth state and the calculation of the shooting conditions are performed by the mobile terminal 102. In this case, the growth state management module 212 of the mobile terminal 102 may determine the growth state, and the mobile terminal 102 may be provided with a shooting condition management module for calculating shooting conditions.
　本実施例における作物の生育状態判定を行う装置を生育管理装置と呼ぶこともある。生育管理装置がクラウド上に配置された管理サーバ１０３である場合には、撮影条件に関する情報の出力先はネットワークにより接続されたモバイル端末１０２であり、生育管理装置がモバイル端末１０２である場合には、撮影条件に関する情報の出力先は前記モバイル端末に備えられた表示部である。 The device for determining the growth state of the crop in this embodiment may be called a growth management device. When the growth management device is the management server 103 arranged on the cloud, the output destination of the information regarding the shooting conditions is the mobile terminal 102 connected by the network, and when the growth management device is the mobile terminal 102. The output destination of the information regarding the shooting conditions is the display unit provided in the mobile terminal.
　また、上述の実施例では、図１４の撮影位置一覧情報１４２２のように圃場の複数の撮影位置を地図上に表示してその撮影順序を示し、圃場管理者がその場所に向かってモバイル端末１０２により写真を取得する。この際、モバイル端末１０２の撮影管理モジュール２１３は、撮影位置へ圃場管理者を誘導するナビゲーション機能を提供してもよい。また、上述したナビゲーション機能に換えて、またはこの機能に加えて、撮影が完了した撮影位置を未撮影位置とは異なる色で表示するなど、撮影完了した位置と撮影未完了の位置とを区別して表示するようにしても良い。当該機能により撮影者は次にどの撮影位置に行けば良いかを容易に把握できるようになる。
　他の実施形態としては、管理サーバ１０３の飛行経路管理モジュールが、撮影条件管理モジュール４１３により算出された撮影位置と撮影時期に基づいて、ドローン１０１の飛行経路を算出し、ドローン１０１のフライトコントローラー５０１が算出された飛行経路に基づいてドローンを飛行させながら撮影を行う構成でもよい。 Further, in the above-described embodiment, as shown in the shooting position list information 1422 in FIG. 14, a plurality of shooting positions of the field are displayed on the map to indicate the shooting order, and the field manager directs the mobile terminal 102 toward the place. Get a photo by. At this time, the photographing management module 213 of the mobile terminal 102 may provide a navigation function for guiding the field manager to the photographing position. In addition, instead of the navigation function described above, or in addition to this function, the shooting position where shooting is completed is displayed in a different color from the non-shooting position, so that the position where shooting is completed and the position where shooting is not completed are distinguished. It may be displayed. With this function, the photographer can easily grasp which shooting position to go to next.
In another embodiment, the flight path management module of the management server 103 calculates the flight path of the drone 101 based on the shooting position and the shooting time calculated by the shooting condition management module 413, and the flight controller 501 of the drone 101. It may be configured to shoot while flying the drone based on the calculated flight path.
　なお、本発明は上記した実施例に限定されるものではなく、様々な変形例が含まれる。例えば、上記した実施例は本発明を分かりやすく説明するために詳細に説明したものであり、必ずしも説明した全ての構成を備えるものに限定されるものではない。また、ある実施例の構成の一部を他の実施例の構成に置き換えることが可能であり、また、ある実施例の構成に他の実施例の構成を加えることも可能である。また、各実施例の構成の一部について、他の構成の追加・削除・置換をすることが可能である。 The present invention is not limited to the above-described embodiment, but includes various modifications. For example, the above-described embodiment has been described in detail in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the one including all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. Further, it is possible to add / delete / replace a part of the configuration of each embodiment with another configuration.
　また、上記の各構成、機能、処理部、処理手段等は、それらの一部又は全部を、例えば集積回路で設計する等によりハードウェアで実現してもよい。また、上記の各構成、機能等は、プロセッサがそれぞれの機能を実現するプログラムを解釈し、実行することによりソフトウェアで実現してもよい。各機能を実現するプログラム、テーブル、ファイル等の情報は、メモリや、ハードディスク、ＳＳＤ（Solid State Drive）等の記録装置、または、ＩＣカード、ＳＤカード、ＤＶＤ等の記録媒体に置くことができる。 Further, each of the above configurations, functions, processing units, processing means, etc. may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be placed in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.
　また、制御線や情報線は説明上必要と考えられるものを示しており、製品上必ずしも全ての制御線や情報線を示しているとは限らない。実際には殆ど全ての構成が相互に接続されていると考えてもよい。
　なお、上述の実施例は少なくとも特許請求の範囲に記載の構成を開示している。 In addition, the control lines and information lines indicate those that are considered necessary for explanation, and do not necessarily indicate all the control lines and information lines in the product. In practice, it can be considered that almost all configurations are interconnected.
It should be noted that the above-mentioned embodiment discloses at least the configuration described in the claims.
１０１…ドローン、１０２…モバイル端末、１０３…管理サーバ、１１０…基地局、２１１…撮影情報管理モジュール、２１２…生育状態管理モジュール、２１３…撮影管理モジュール、４１１…撮影情報管理モジュール、４１２…生育状態管理モジュール、４１３…撮影条件管理モジュール、４００…地図情報、５００…圃場管理情報、６００…撮影条件管理情報、７００…撮影情報管理情報、８００…生育状態管理情報 101 ... Drone, 102 ... Mobile terminal, 103 ... Management server, 110 ... Base station, 211 ... Shooting information management module, 212 ... Growth status management module, 213 ... Shooting management module, 411 ... Shooting information management module, 412 ... Growth status Management module, 413 ... Shooting condition management module, 400 ... Map information, 500 ... Field management information, 600 ... Shooting condition management information, 700 ... Shooting information management information, 800 ... Growth state management information

Claims (20)

  1. 　作物の生育管理装置であって、
    　カメラにより撮影された画像情報を取得する取得部と、
    　取得した画像情報に基づいて作物の生育状態を判定する判定部と、
    　情報を出力する出力部と、
    を有し、
    　前記出力部は、前記作物の生育状態を判定するための撮影条件に関する情報を出力することを特徴とする生育管理装置。     It is a crop growth management device
    An acquisition unit that acquires image information taken by a camera,
    Judgment unit that determines the growth state of the crop based on the acquired image information,
    An output section that outputs information and
    Have,
    The output unit is a growth management device, characterized in that it outputs information regarding imaging conditions for determining the growth state of the crop.
  2. 　前記撮影条件は、過去の撮影により得られた前記作物の生育状態、地形情報、土壌状態、の少なくともいずれかに基づいて算出された一つ又は複数の撮影位置である請求項１に記載の生育管理装置。 The growth according to claim 1, wherein the imaging condition is one or more imaging positions calculated based on at least one of the growth state, topographical information, and soil condition of the crop obtained by past imaging. Management device.
  3. 　同一の撮影位置の過去の複数回の撮影により得られた前記作物の生育状態の変化が所定の値以下の場合には、前記同一の撮影位置に関する情報を前記撮影条件として出力しない請求項２に記載の生育管理装置。 Claim 2 does not output information on the same shooting position as the shooting condition when the change in the growth state of the crop obtained by the past multiple shootings at the same shooting position is not more than a predetermined value. The described growth management device.
  4. 　前記撮影条件は、過去の撮影の撮影方位、前記作物の条、撮影時の太陽光の向き、の少なくともいずれかに基づいて算出された撮影の方位である請求項１～３のいずれか１項に記載の生育管理装置。 The shooting condition is any one of claims 1 to 3, which is a shooting direction calculated based on at least one of the shooting direction of the past shooting, the crop strip, and the direction of sunlight at the time of shooting. The growth management device described in.
  5. 　前記撮影条件は、過去の撮影の角度、又は撮影する前記作物に対して予め定められた所定の角度、の少なくともいずれかに基づいて算出された撮影の角度である請求項１～４のいずれか１項に記載の生育管理装置。 The shooting condition is any one of claims 1 to 4, which is a shooting angle calculated based on at least one of a past shooting angle or a predetermined angle predetermined with respect to the crop to be shot. The growth management device according to item 1.
  6. 　前記撮影条件は、撮影手順である請求項１～５のいずれか１項に記載の生育管理装置。 The imaging condition is the growth management device according to any one of claims 1 to 5, which is an imaging procedure.
  7. 　前記撮影条件は、撮影する前記作物に対する距離、又は地表からの距離、の少なくともいずれかである請求項１～６のいずれか１項に記載の生育管理装置。 The growth management device according to any one of claims 1 to 6, wherein the photographing condition is at least one of a distance to the crop to be photographed or a distance from the ground surface.
  8. 　前記撮影条件は、生育撮影する前記作物に対する撮影個所である請求項１～７のいずれか１項に記載の生育管理装置。 The imaging condition is the growth management device according to any one of claims 1 to 7, which is a photographing location for the crop to be photographed for growth.
  9. 　撮影する前記作物に対する撮影個所は、前記作物の過去の生育履歴情報、又は日時に基づいて判定される請求項８に記載の生育管理装置。 The growth management device according to claim 8, wherein the shooting location for the crop to be photographed is determined based on the past growth history information of the crop or the date and time.
  10. 　撮影する前記作物に対する撮影個所は、前記作物の生育時期に基づいて判定され、前記作物の前記生育時期は、前記作物に対する病気が流行する時期、前記作物が出穂する時期、の少なくともいずれかである請求項８に記載の生育管理装置。 The imaging location for the crop to be photographed is determined based on the growth time of the crop, and the growth time of the crop is at least one of the time when the disease for the crop is prevalent and the time when the crop is heading. The growth management device according to claim 8.
  11. 　前記撮影条件は、前記作物の生育フェーズ、前記作物に対する病気が流行する時期、過去の撮影により得られた前記作物の生育状態の変化傾向、の少なくともいずれかに基づいて算出された撮影時期である請求項１～１０のいずれか１項に記載の生育管理装置。 The imaging condition is an imaging time calculated based on at least one of the growth phase of the crop, the time when a disease for the crop is prevalent, and the tendency of change in the growing state of the crop obtained by past imaging. The growth management device according to any one of claims 1 to 10.
  12. 　前記撮影条件の少なくとも一部が満たされたことを判定した場合に、前記カメラが撮影を実行する請求項１～１１のいずれか１項に記載の生育管理装置。 The growth management device according to any one of claims 1 to 11, wherein the camera executes imaging when it is determined that at least a part of the imaging conditions is satisfied.
  13. 　前記撮影条件の少なくとも一部が満たされたことを判定した場合に、撮影を促す表示を出力する請求項１～１１のいずれか１項に記載の生育管理装置。 The growth management device according to any one of claims 1 to 11, which outputs a display prompting for shooting when it is determined that at least a part of the shooting conditions is satisfied.
  14. 　前記撮影条件の少なくとも一部が満たされたことを判定した場合に、前記カメラが撮影を実行し、前記撮影条件が満たされない場合に、撮影を促す表示を出力する請求項１～１１のいずれか１項に記載の生育管理装置。 Any of claims 1 to 11 that the camera executes shooting when it is determined that at least a part of the shooting conditions is satisfied, and outputs a display prompting shooting when the shooting conditions are not satisfied. The growth management device according to item 1.
  15. 　前記出力部は、前記撮影条件の少なくとも一部が満たされたことを判定した場合に撮影を実行する自動撮影ボタンと、前記撮影条件の少なくとも一部が満たされたか否かにかかわらず撮影を実行する撮影ボタンと、を出力する請求項１～１４のいずれか１項に記載の生育管理装置。 The output unit has an automatic shooting button that executes shooting when it is determined that at least a part of the shooting conditions is satisfied, and shoots regardless of whether or not at least a part of the shooting conditions is satisfied. The growth management device according to any one of claims 1 to 14, wherein a shooting button is output.
  16. 　前記出力部は、過去の撮影により得られた前記作物の生育状態が病気の兆候を示していると判定された場合に、作業指示情報を出力する請求項１～１５のいずれか１項に記載の生育管理装置。 The output unit according to any one of claims 1 to 15, which outputs work instruction information when it is determined that the growth state of the crop obtained by past imaging indicates a sign of a disease. Growth management device.
  17. 　前記生育管理装置はクラウド上に配置されたサーバであり、前記撮影条件に関する情報の出力先はネットワークにより接続されたモバイル端末である請求項１～１６のいずれか１項に記載の生育管理装置。 The growth management device according to any one of claims 1 to 16, wherein the growth management device is a server arranged on the cloud, and the output destination of the information regarding the shooting conditions is a mobile terminal connected by a network.
  18. 　前記生育管理装置はモバイル端末であり、前記撮影条件に関する情報の出力先は前記モバイル端末に備えられた表示部である請求項１～１６のいずれか１項に記載の生育管理装置。 The growth management device according to any one of claims 1 to 16, wherein the growth management device is a mobile terminal, and the output destination of information regarding the shooting conditions is a display unit provided on the mobile terminal.
  19. 　生育管理装置を請求項１～１８のいずれか１項に記載の取得部、判定部、及び出力部として機能させるための作物の生育管理プログラム。 A crop growth management program for making the growth management device function as an acquisition unit, a determination unit, and an output unit according to any one of claims 1 to 18.
  20. 　カメラにより撮影された画像情報を取得し、
    　取得した画像情報に基づいて作物の生育状態を判定し、
    　前記作物の生育状態を判定するための撮影条件に関する情報を出力する
    ことを特徴とする生育管理装置における作物の生育管理方法。

          Acquires image information taken by the camera and
    Judging the growth state of the crop based on the acquired image information,
    A crop growth management method in a growth management device, which outputs information on imaging conditions for determining the growth state of the crop.
PCT/JP2020/024247 2020-06-19 2020-06-19 Crop growth management device and crop growth management method WO2021255941A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2022531241A JPWO2021255941A1 (en) 2020-06-19 2020-06-19
PCT/JP2020/024247 WO2021255941A1 (en) 2020-06-19 2020-06-19 Crop growth management device and crop growth management method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/024247 WO2021255941A1 (en) 2020-06-19 2020-06-19 Crop growth management device and crop growth management method

Publications (1)

Publication Number Publication Date
WO2021255941A1 true WO2021255941A1 (en) 2021-12-23

Family

ID=79267689

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/024247 WO2021255941A1 (en) 2020-06-19 2020-06-19 Crop growth management device and crop growth management method

Country Status (2)

Country Link
JP (1) JPWO2021255941A1 (en)
WO (1) WO2021255941A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3081654U (en) * 2001-05-10 2001-11-16 株式会社イー・シー・アール Crop growth monitoring system
JP4012554B2 (en) * 2005-11-02 2007-11-21 独立行政法人農業・食品産業技術総合研究機構 Plant growth information processing system
JP5499523B2 (en) * 2009-06-11 2014-05-21 大日本印刷株式会社 Crop purchase system, crop purchase method, management server, program and recording medium
US20200034616A1 (en) * 2018-07-26 2020-01-30 Scientific Cal Ag, Inc. Method of Crop Analysis using Drone with Flying and Driving Capability
JP2020074141A (en) * 2020-01-08 2020-05-14 株式会社日本総合研究所 Information processing apparatus, program, information processing system and data structure

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3081654U (en) * 2001-05-10 2001-11-16 株式会社イー・シー・アール Crop growth monitoring system
JP4012554B2 (en) * 2005-11-02 2007-11-21 独立行政法人農業・食品産業技術総合研究機構 Plant growth information processing system
JP5499523B2 (en) * 2009-06-11 2014-05-21 大日本印刷株式会社 Crop purchase system, crop purchase method, management server, program and recording medium
US20200034616A1 (en) * 2018-07-26 2020-01-30 Scientific Cal Ag, Inc. Method of Crop Analysis using Drone with Flying and Driving Capability
JP2020074141A (en) * 2020-01-08 2020-05-14 株式会社日本総合研究所 Information processing apparatus, program, information processing system and data structure

Also Published As

Publication number Publication date
JPWO2021255941A1 (en) 2021-12-23

Similar Documents

Publication Publication Date Title
US10495884B2 (en) Visual perception enhancement of displayed color symbology
CA2970894C (en) Visual perception enhancement of displayed color symbology
US9945828B1 (en) Airborne multispectral imaging system with integrated navigation sensors and automatic image stitching
US20170336203A1 (en) Methods and systems for remote sensing with drones and mounted sensor devices
US11319067B2 (en) Drone for capturing images of field crops
WO2016030878A1 (en) Self-image augmentation
JP5162890B2 (en) Correction method in remote sensing
JP2018046787A (en) Agricultural management prediction system, agricultural management prediction method, and server apparatus
US20140176705A1 (en) Photographing apparatus, information providing method, and computer product
US20210333755A1 (en) Device, system, and method of growing virtual plant
CN110537197A (en) Image processing apparatus, maturation history image creation system and program
EP3703005A1 (en) Information processing device, information processing method, program, and information processing system
JP2021012433A (en) Information processing apparatus, information processing method, program, and sensing system
WO2021255941A1 (en) Crop growth management device and crop growth management method
WO2021255940A1 (en) Drone for diagnosing crop growth, and camera system for same
CN110057451A (en) Multispectral data acquisition system and method
JPWO2019235240A1 (en) Information processing device
US20230408889A1 (en) Imaging apparatus and lens apparatus
KR102402949B1 (en) Acquisition method of image information with improved precision
WO2021017914A1 (en) Control device, camera device, movable body, control method, and program
WO2021132276A1 (en) Agriculture support system
JP2021033482A (en) Flying body support system
JP7152212B2 (en) Growth information display system
WO2021149355A1 (en) Information processing device, information processing method, and program
WO2020192385A1 (en) Determination device, camera system, and moving object

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20941295

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022531241

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20941295

Country of ref document: EP

Kind code of ref document: A1