CN104949916B - The formula that drops corn ear panicled characters measurement apparatus and its measuring method - Google Patents
The formula that drops corn ear panicled characters measurement apparatus and its measuring method Download PDFInfo
- Publication number
- CN104949916B CN104949916B CN201510289154.1A CN201510289154A CN104949916B CN 104949916 B CN104949916 B CN 104949916B CN 201510289154 A CN201510289154 A CN 201510289154A CN 104949916 B CN104949916 B CN 104949916B
- Authority
- CN
- China
- Prior art keywords
- corn ear
- ear
- described image
- measurement apparatus
- drops
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Image Processing (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Dropped formula corn ear panicled characters measurement apparatus the present invention relates to one kind, it is characterised in that including：Delivery unit, vertical conduit, image acquisition units and control process unit；Delivery unit includes the first conveyer belt, so that corn ear enters the vertical conduit after first conveyer belt；Vertical conduit, for making corn ear be fallen in vertical state；Image acquisition units, for gathering the image information of the corn ear fallen in vertical state in the horizontal direction；Image acquisition units are connected with control process unit, and send the image information of the corn ear collected to control process unit and handled；Control process unit, the image information of the corn ear for handling image acquisition units transmission, to obtain the panicled characters information of corn ear.The present invention completes collection to the comprehensive three-view diagram picture of corn ear in fruit ear moment of dropping, and calculates Ear Characters information accordingly, and measuring speed is fast, and measurement result is more accurate.
Description
Technical field
The present invention relates to corn ear test technical field, more particularly to one kind drops the measurement of formula corn ear panicled characters
Device and its measuring method.
Background technology
Corn is the main cereal crops in China, occupies critical role in China's agricultural production.Corn breeding is China
The important component in the fields such as the scientific research of kind industry, production.One of key problem as corn breeding, corn ear test has
Important meaning.During corn ear test, bald sharp length, tassel row number and the row grain number of fruit ear be it is most common and compared with
For important breeding character.Therefore, corn ear test needs to carry out fruit ear comprehensive measurement.Current domestic corn fringe portion
Species test is mostly using traditional means such as range estimation dipstick meterings, and every batch needs the corn quantity of species test all very big, traditional species test
Journey generally requires lasting more than one month, there is human cost consumption it is excessive, operating efficiency is difficult to improve and accuracy is low
Inferior many drawbacks.
Disclosed a kind of corn ear test mthods, systems and devices based on computer vision technique in the prior art,
Multiple appearance character parameters such as the spike length of corn ear, tassel row number, row grain number, bald sharp length can be measured.However, its design
Device can not collect the full angle information of fruit ear.It is another that prior art discloses a kind of corn ear character detection means, profit
Rotated with two rollers rotating around respective axis uniform rotation and by frictional force drives corn ears, linear array CCD camera is from corn
Fruit ear face corn ear is scanned shooting, disposable to obtain the all-round image of corn ear, then this collection corn ear
Full angle information method spent time it is longer, it is less efficient.
In summary, need badly and design one kind and can realize that year old corn ear test parameter carries out comprehensive precision measurement
Device and measuring method, the defects of to overcome prior art, to promote the development of modern Maize seed industry.
The content of the invention
The technical problems to be solved by the invention be how to realize it is quickly accurate to the comprehensive trait information of corn ear
Collection.
For this purpose, on the one hand, the present invention proposes one kind and dropped formula corn ear panicled characters measurement apparatus, including：
Delivery unit, vertical conduit, image acquisition units and control process unit；
The delivery unit includes the first conveyer belt, the upper port phase of the first transmission end of tape and the vertical conduit
Neighbour, so that corn ear enters the vertical conduit after first conveyer belt；
The vertical conduit, for making corn ear be fallen in vertical state, the upper port diameter of the vertical conduit is only
Single fringe corn ear can be accommodated to pass through；
Described image collecting unit, the image for gathering the corn ear fallen in vertical state in the horizontal direction are believed
Breath；Described image collecting unit is connected with the control process unit, and the image information of the corn ear collected is passed
The control process unit is given to be handled；
The control process unit, the image information of the corn ear for handling the transmission of described image collecting unit, with
Obtain the panicled characters information of corn ear.
Preferably, described image collecting unit includes IMAQ casing and some camera devices；
Described image collection casing upper face center is provided with the first opening, and described image collection casing lower surface center is provided with
Second opening, first opening, the second opening are vertically aligned；
Some camera devices are located on the described image collection same horizontal plane of box house, and sight is directed at the figure
As collection casing center.
Preferably, described image collecting unit also includes infrared trigger, and described image is fallen into for detecting corn ear
Gather the time of casing and send the signal for starting IMAQ；The infrared trigger is located above the camera device, institute
State the infrared ray alignment described image collection casing center of infrared trigger transmitting.
Preferably, described image collecting unit also includes lighting source, and the lighting source is located at described image vasculum
Internal portion.
Preferably, the lighting source is two annular LED light sources, and described two annular LED light sources are respectively positioned at described
First opening lower section and the second overthe openings, and the lower port of described two annular LED light sources and the vertical conduit is along vertical
Align in direction.
Preferably, the vertical conduit upper port is towards first conveyer belt, and the vertical conduit upper port and institute
State the first conveyer belt and be in same level.
Preferably, in addition to fruit ear recovery unit, for buffering and reclaiming the corn ear to drop, the fruit ear recovery is single
Member is connected with described image collecting unit.
Preferably, the fruit ear recovery unit includes：Slope guide rails and the second conveyer belt；The slope guide rails are positioned at described
Second opening lower section, the slope guide rails lower end is connected with second conveyer belt.
Preferably, described control process unit is computer, using Stereo Vision, is gathered according to described image single
The image information of the corn ear of member transmission carries out spatial profiles measurement to corn ear, to obtain the panicled characters of corn ear
Information.
On the other hand, the invention also provides one kind drops formula corn ear panicled characters measuring method, including following step
Suddenly：
S1. corn ear is sent to vertical conduit by the first conveyer belt；
S2. the vertical conduit guiding corn ear is fallen vertically；
S3. infrared trigger detects the moment that falls into of fruit ear, sends IMAQ to some camera devices immediately
Signal, some camera devices are taken pictures to corn ear simultaneously；
S4. some camera devices send the image information collected to control process unit, the control process
Unit carries out spatial profiles measurement according to described image Information Pull Stereo Vision to corn ear, obtains corn ear
Panicled characters information；
S5. the corn ear tumbled along slope guide rails is transported at fruit ear recovery by the second conveyer belt.
Drop formula corn ear panicled characters measurement apparatus and its measuring method disclosed in this invention, pass through lighting source
Combined with camera device, the collection for the moment completion three-view diagram picture comprehensive to corn ear that dropped in corn ear, and with this
The trait information of corn ear is calculated, can realize the tassel row number of nondestructive measurement corn ear, row grain number, grain number per spike etc. often
See character parameter, measurement result is more accurate, objective, science, and measuring speed is fast, improves measurement efficiency, for realizing entirely certainly
Dynamic high speed corn breeding has great significance and reference value.
Brief description of the drawings
The features and advantages of the present invention can be more clearly understood by reference to accompanying drawing, accompanying drawing is schematically without that should manage
Solve to carry out any restrictions to the present invention, in the accompanying drawings：
Fig. 1 shows the overall structure diagram of the formula corn ear panicled characters measurement apparatus of the invention that drops；
Fig. 2 shows the flow chart of the formula corn ear panicled characters measuring method of the invention that drops.
Reference：1st, corn ear；2nd, the first conveyer belt；3rd, vertical conduit；4th, IMAQ casing；5th, shooting dress
Put；6th, infrared trigger；7th, lighting source；8th, slope guide rails；9th, the second conveyer belt.
Embodiment
Below in conjunction with accompanying drawing, embodiments of the present invention is described in detail.
Embodiment 1
One embodiment of the panicled characters measurement apparatus of formula the corn ear 1 as shown in figure 1, present invention drops, including：Transmission
Unit, vertical conduit, image acquisition units and control process unit.
Delivery unit includes the first conveyer belt 2, and the end of the first conveyer belt 2 is adjacent with the upper port of vertical conduit 3, so that beautiful
Rice cracker fringe enters vertical conduit 3 after the first conveyer belt 2；Preferably, the edge of the first conveyer belt 2 is provided with shirt rim.
Image acquisition units include：IMAQ casing 4, several camera devices 5 and infrared trigger 6.Wherein, image
Collection casing 4 is used to receive the corn ear 1 to drop, and the upper face center of IMAQ casing 4 is provided with the first opening, IMAQ
The lower surface of casing 4 center is provided with second the first opening of opening and the second opening is vertically aligned；The upper table of IMAQ casing 4
First opening in face center is vertically aligned with the vertical lower port of conduit 3, and corn ear 1 erects from the vertical lower port of conduit 3
It is straight enter IMAQ casing 4, to carry out IMAQ.Camera device 5 is located at the same water in inside of described image collection casing 4
In plane, sight alignment described image collection casing 4 center.Preferably, three camera devices 5 are set, positioned at same level
On face, shooting direction points to the center of IMAQ casing 4, and mutually coordinate hexagonal angle.Three camera devices 5 are taken pictures simultaneously, by corn
The three-view drawing picture of fruit ear 1, which is sent to control process unit, to be handled.Optionally, high-speed industrial CCD camera, the series can be used
Industrial camera is using exposed frame CCD as sensor.Picture quality is high, and color is Well-recovered.To ensure in dynamic acquisition, can obtain
To the high quality image without deformation.Image acquisition units are connected with the control process unit, and the corn ear 1 that will be collected
Image information send the control process unit to and handled.
Infrared trigger 6 in image acquisition units, described image collection casing 4 is fallen into for detecting corn ear 1
Time simultaneously sends image pick-up signal.The operation principle of infrared trigger 6 is as follows：Infrared trigger 6 includes RF transmitter
And receiver.RF transmitter launches sightless infrared light beam, faces and receives window on receiver accordingly, works as shifting
When dynamic object passes through between transmitter and receiver, infrared beam is separated, and causes receiver to be triggered, immediately to shooting
Device 5 sends signal, triggers next equipment.In the present embodiment, infrared trigger 6 is arranged at the top of camera device 5.Infrared triggering
The infrared ray alignment described image collection casing center of device transmitting, i.e., the infrared light beam of RF transmitter transmitting is by default
The descent path of good corn ear 1, when corn ear 1 is fallen into IMAQ casing 4 vertically from the vertical lower port of conduit 3
When, infrared beam is separated, and causes receiver to be triggered, and sends signal to camera device 5 immediately, triggers the fast of camera device 5
Door, complete IMAQ.
Image acquisition units also include lighting source 7, and the lighting source 7 is located inside described image collection casing 4, used
In providing illumination to fall into the surface of the corn ear 1 of described image collecting unit.The lighting source 7 is strong for several annulars
Light LED light source.Preferably, the inside of IMAQ casing 4 sets two annular white LED light sources, respectively positioned at IMAQ case
First opening lower section of body 4 and the second overthe openings, and the lower port edge of described two annular LED light sources and the vertical conduit
Vertical direction aligns.Two annular white LED light sources light filling into figure vasculum body, to improve gathered corn ear 1
The definition of image, so as to improve the accuracy for the Ear Characters information that the gathered image procossing of corn ear 1 obtains.
The vertical upper-end bent of conduit 3, and angle of bend is relatively slow, in order to avoid block fruit ear；Upper port transmits towards described first
Band 2, and upper port is in same level with the first conveyer belt 2.The vertical lower port of conduit 3 and described image collection casing 4
First opening is vertically aligned.The diameter of the vertical upper port of conduit 3 is approximately equal to the diameter of corn ear 1, to ensure one
It is secondary to be only capable of allowing a corn ear 1 to pass through.Preferably, vertical conduit 3 is in cylinder.Fall in fruit ear is adjusted into vertical state
Enter described image collecting unit.
Control process unit, for controlling described image collecting unit and handling the corn of described image collecting unit transmission
The image information of fruit ear 1, to obtain the panicled characters information of corn ear 1.Control process unit is computer, utilizes stereopsis
Feel method carries out spatial profiles measurement to corn ear 1, to obtain the panicled characters information of corn ear 1.In the present embodiment, when
Corn ear 1 from the vertical lower port of conduit 3 fall into vertically in IMAQ casing 4 when, infrared trigger 6 is triggered, immediately to
Camera device 5 sends signal, triggers the shutter of camera device 5, three camera devices 5 are taken pictures simultaneously, by three faces of corn ear 1
Image is sent to processing computer, and computer can carry out the calculating of three dimensional space coordinate according to the parallax of this three width image, to jade
The space distribution situation of rice cracker fringe 1 is reduced, so as to calculate the parameters such as the tassel row number of corn ear 1, row grain number, grain number per spike.
The panicled characters measurement apparatus of the formula that drops corn ear 1, in addition to fruit ear recovery unit, drop for buffering and reclaiming
Corn ear 1, fruit ear recovery unit is connected with described image collecting unit.Fruit ear recovery unit includes：The He of slope guide rails 8
Second conveyer belt 9.Skewed slot guide rail lower end is connected with the second conveyer belt 9.Slope guide rails 8 are located at the lower section of IMAQ casing 4, and just
To the lower port of vertical conduit 3, the fruit ear to be dropped from IMAQ casing 4 will be caught by slope guide rails 8, and finally be rolled down to
On second conveyer belt 9, it is transported at recovery fruit ear.Preferably, slope guide rails 8 use sponge material, for buffering the jade to drop
Rice cracker fringe 1, keep the complete of fruit ear.
Embodiment 2
As shown in Fig. 2 the present invention drops in one embodiment of the panicled characters measuring method of formula corn ear 1, including with
Lower step：
S1. corn ear 1 is sent to vertical conduit 3 by the first conveyer belt 2；
S2. the vertical conduit 3 guides corn ear 1 to fall vertically；
S3. infrared trigger 6 detects the moment that falls into of corn ear 1, sends figure to some camera devices 5 immediately
As collection signal, some camera devices 5 are taken pictures to corn ear 1 simultaneously；
S4. some camera devices 5 send the image information collected to control process unit, the control process
Unit carries out spatial profiles measurement according to described image Information Pull Stereo Vision to corn ear 1, obtains corn ear 1
Panicled characters information；
S5. the corn ear 1 tumbled along slope guide rails 8 is transported at fruit ear recovery by the second conveyer belt 9.
Drop formula corn ear panicled characters measurement apparatus and its measuring method in the embodiment of the present invention, pass through illumination light
Source is combined with camera device obtains the comprehensive three-view diagram picture of corn ear, and calculates Ear Characters information with this, can realize
The common character parameters such as the tassel row number of nondestructive measurement corn ear, row grain number, grain number per spike, measurement result is more accurate, objective, section
Learn.Whole measurement process is completed in corn ear moment of dropping, and measuring speed is fast, improves measurement efficiency, for realize entirely from
Dynamic high speed corn breeding has great significance and reference value.
Claims (9)
- The formula corn ear panicled characters measurement apparatus 1. one kind drops, it is characterised in that including：Delivery unit, vertical conduit, figure As collecting unit and control process unit；The delivery unit includes the first conveyer belt, and the first transmission end of tape is adjacent with the upper port of the vertical conduit, So that corn ear enters the vertical conduit after first conveyer belt；The vertical conduit, for making corn ear be fallen in vertical state, the upper port diameter of the vertical conduit is only capable of holding Single fringe corn ear is received by, the upper-end bent of the vertical conduit, and angle of bend is gentle；Described image collecting unit, for gathering the image information of the corn ear fallen in vertical state in the horizontal direction；Institute State image acquisition units with the control process unit to be connected, and send the image information of the corn ear collected to institute Control process unit is stated to be handled；The control process unit, the image information of the corn ear for handling the transmission of described image collecting unit, to obtain The panicled characters information of corn ear.
- 2. the formula corn ear panicled characters measurement apparatus according to claim 1 that drops, it is characterised in that described image is adopted Collection unit includes IMAQ casing and some camera devices；Described image collection casing upper face center is provided with the first opening, and described image collection casing lower surface center is provided with second Opening, first opening, the second opening and the lower port of the vertical conduit are vertically aligned；Some camera devices are located on the described image collection same horizontal plane of box house, and sight alignment described image is adopted Collect casing center.
- 3. the formula corn ear panicled characters measurement apparatus according to claim 2 that drops, it is characterised in that described image is adopted Collection unit also includes infrared trigger, starts figure for detecting corn ear and falling into the time of described image collection casing and send As the signal of collection；The infrared trigger is located above the camera device, the infrared ray pair of the infrared trigger transmitting Quasi- described image collection casing center.
- 4. the formula corn ear panicled characters measurement apparatus according to claim 2 that drops, it is characterised in that described image is adopted Collection unit also includes lighting source, and the lighting source is located at described image collection box house.
- 5. the formula corn ear panicled characters measurement apparatus according to claim 4 that drops, it is characterised in that the illumination light Source is two annular LED light sources, and described two annular LED light sources are respectively on the described first opening lower section and the second opening Side, and the lower port of described two annular LED light sources and the vertical conduit is vertically aligned.
- 6. the formula corn ear panicled characters measurement apparatus according to claim 1 that drops, it is characterised in that described to lead vertically Pipe upper port is towards first conveyer belt, and the vertical conduit upper port is in same level with first conveyer belt Face.
- 7. the formula corn ear panicled characters measurement apparatus according to claim 2 that drops, it is characterised in that also including fruit ear Recovery unit, for buffering and reclaiming the corn ear to drop, the fruit ear recovery unit is connected with described image collecting unit Connect.
- 8. the formula corn ear panicled characters measurement apparatus according to claim 7 that drops, it is characterised in that the fruit ear returns Receiving unit includes：Slope guide rails and the second conveyer belt；The slope guide rails are positioned at the described second opening lower section, the slope guide rails Lower end is connected with second conveyer belt.
- 9. the formula corn ear panicled characters measurement apparatus according to claim 1 that drops, it is characterised in that described control Processing unit is computer, and using Stereo Vision, the image of the corn ear transmitted according to described image collecting unit is believed Breath carries out spatial profiles measurement to corn ear, to obtain the panicled characters information of corn ear.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510289154.1A CN104949916B (en) | 2015-05-29 | 2015-05-29 | The formula that drops corn ear panicled characters measurement apparatus and its measuring method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510289154.1A CN104949916B (en) | 2015-05-29 | 2015-05-29 | The formula that drops corn ear panicled characters measurement apparatus and its measuring method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104949916A CN104949916A (en) | 2015-09-30 |
| CN104949916B true CN104949916B (en) | 2017-12-01 |
Family
ID=54164740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510289154.1A Expired - Fee Related CN104949916B (en) | 2015-05-29 | 2015-05-29 | The formula that drops corn ear panicled characters measurement apparatus and its measuring method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104949916B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108445003B (en) * | 2018-03-19 | 2021-05-18 | 烟台大学 | Fruit quality detection device and detection method |
| CN110615293B (en) * | 2018-06-19 | 2021-09-14 | 佛山市顺德区美的电热电器制造有限公司 | Automatic image data acquisition system, automatic image data acquisition method and automatic image data identification system |
| CN109513640A (en) * | 2019-01-07 | 2019-03-26 | 山东泓盛智能科技有限公司 | Grain unsound grain Smart Verify instrument |
| CN112184703B (en) * | 2020-10-27 | 2023-08-01 | 广东技术师范大学 | Corn ear period unmanned aerial vehicle image alignment method and system based on space-time backtracking |
| CN114002220B (en) * | 2021-11-10 | 2024-05-24 | 美骏智能装备(盘锦)有限公司 | Intelligent analyzer for rice processing precision |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201733838U (en) * | 2010-08-23 | 2011-02-09 | 郑州海意科技有限公司 | Automatic weighing device used in filter stick/ cigarette on-line detection system |
| CN203344085U (en) * | 2013-07-08 | 2013-12-18 | 安徽中人科技有限责任公司 | Implant fixed-distance segmenting device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101933417B (en) * | 2010-07-06 | 2012-05-30 | 北京农业智能装备技术研究中心 | Corn seed investigating device based on machine vision |
| CN102252944A (en) * | 2011-05-06 | 2011-11-23 | 清华大学 | Measurement method for particle size |
| CN104865259B (en) * | 2015-05-07 | 2017-12-22 | 中国农业大学 | The formula that drops corn ear fringe portion holography character Fast measurement system and method |
-
2015
- 2015-05-29 CN CN201510289154.1A patent/CN104949916B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201733838U (en) * | 2010-08-23 | 2011-02-09 | 郑州海意科技有限公司 | Automatic weighing device used in filter stick/ cigarette on-line detection system |
| CN203344085U (en) * | 2013-07-08 | 2013-12-18 | 安徽中人科技有限责任公司 | Implant fixed-distance segmenting device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104949916A (en) | 2015-09-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104949916B (en) | The formula that drops corn ear panicled characters measurement apparatus and its measuring method | |
| CN103521465B (en) | A kind of automatic detection of solid grain and separation system and method | |
| CN101419058B (en) | Plant haulm diameter measurement device and measurement method based on machine vision | |
| CN104198324B (en) | Computer vision-based method for measuring proportion of cut leaves in cut tobacco | |
| CN206810710U (en) | A kind of quick-fried pearl filter stick detection means of cigarette based on machine vision | |
| CN105318944B (en) | The chicken scene weighing system and method for rod-shaped platform | |
| CN104482860B (en) | Fish morphological parameters self-operated measuring unit and method | |
| CN106000912B (en) | One kind realizes citrus cyst foreign body eliminating system based on machine vision guiding | |
| CN107741432A (en) | A kind of fruit automatic sorting machine people's system based on machine vision | |
| CN206382252U (en) | A kind of cordyceps sinensis sorting device | |
| CN105548198B (en) | The method of complex product quality automatic detection based on cloud platform | |
| CN101482518A (en) | On-line quality detection system for movable band-shaped material | |
| CN103942773B (en) | Method and device for obtaining queuing length through image analysis | |
| CN109613003A (en) | A kind of appearance quality detecting device and method | |
| CN103331269A (en) | Seed sorting system | |
| CN102879404B (en) | System for automatically detecting medical capsule defects in industrial structure scene | |
| CN105549486A (en) | Tobacco topping sprouting inhibition detection control system based on machine vision | |
| CN106599838A (en) | Dynamic time delay adjusting device and method for unginned cotton foreign fiber sorting system | |
| CN110092159A (en) | Article delivery method and equipment | |
| CN103376270A (en) | Component-counting method on basis of X-ray linear scanning and counting device thereof | |
| CN207126835U (en) | A kind of potato Fast nondestructive evaluation self-grading device | |
| CN106408557A (en) | Viscose long filament and broken filament detection method based on image processing technology | |
| CN107389694A (en) | A kind of more ccd video camera synchronous signal acquisition apparatus and method | |
| CN206951597U (en) | A kind of Blueberry hierarchical detection system based on machine vision | |
| CN104865259B (en) | The formula that drops corn ear fringe portion holography character Fast measurement system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20171201 Termination date: 20210529 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |