CN100399184C - Projector and method for implementing electronic whiteboard function thereof - Google Patents

Projector and method for implementing electronic whiteboard function thereof Download PDF

Info

Publication number
CN100399184C
CN100399184C CNB2003101212610A CN200310121261A CN100399184C CN 100399184 C CN100399184 C CN 100399184C CN B2003101212610 A CNB2003101212610 A CN B2003101212610A CN 200310121261 A CN200310121261 A CN 200310121261A CN 100399184 C CN100399184 C CN 100399184C
Authority
CN
China
Prior art keywords
mouse
key
projector
image
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2003101212610A
Other languages
Chinese (zh)
Other versions
CN1629719A (en
Inventor
尚可
赵牧
刘渤
赵俊先
刘光辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CNB2003101212610A priority Critical patent/CN100399184C/en
Publication of CN1629719A publication Critical patent/CN1629719A/en
Application granted granted Critical
Publication of CN100399184C publication Critical patent/CN100399184C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Drawing Aids And Blackboards (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The present invention discloses a projector and a method for realizing the function of an electronic whiteboard. The projector comprises an electronic whiteboard module, a control device and a projection module, wherein the electronic whiteboard module receives image signals and control signals transmitted by the control device, executes the drawing process of a whiteboard image and draws the whiteboard image. Simultaneously, the image synthesis program is executed for synthesizing the whiteboard image and an input image, the synthesis image is output to the projection module for projection. The projector and the method of the present invention are used. When a user uses the projector for demonstration and explanation, operation, such as drawing, annotation, emphasis prompt, etc., are conveniently and rapidly carried out on a projected image. The projector practicability is improved, and thereby, the work efficiency is further improved.

Description

The method of a kind of projector and realization electronic whiteboard function thereof
Technical field
The present invention relates to projection display technique, relate in particular to the method for a kind of projector and realization electronic whiteboard function thereof, described electronic whiteboard function is: when with the projector projection, the user can utilize opertaing device simulation paintbrush draw virtual electronic image, i.e. whiteboard images on projected image.
Background technology
At present, projection display apparatus is widely used in occasions such as meeting, demonstration, speech.In the use of these occasions, the user often need carry out operations such as some notes or emphasis prompting on PowerPoint.Prior art has three kinds of schemes to be used to achieve this end usually:
1, miniature semiconductor laser.This semiconductor laser has very little volume, and the one-pen size is arranged usually, can make things convenient for the user to carry.But because this laser instrument light energy output is lower, luminous point is also very little on curtain, is not very good so use its effect of demonstrating, explaining, and can not draws on display screen.
2, the application software of some WINDOWS operating systems allows user's operation of directly drawing on display screen, as lantern slide and presentation software POWER POINT XP EDITION, make in this way and can obtain effect preferably, but its shortcoming is can only be to the file that moves in this software operation of drawing, after withdrawing from this software, the user just can't use the function of picture.
3, use board personal computer (TABLET PC), TABLET PC supports user's operation of directly drawing on the screen of TABLET PC, the screen of TABLET PC can show by the figure that the user is drawn, and by projection display apparatus output projection, but the shortcoming of this scheme is present TABLET PC not to be popularized, and price is more expensive, and cost is too high.
Summary of the invention
In view of this, fundamental purpose of the present invention provides a kind of projector and realizes the method for electronic whiteboard function, make the user demonstrate, when explaining, on projected image, carry out operations such as some pictures, note, emphasis prompting quickly and easily, improve the practicality of projection display apparatus.
To achieve these goals, technical scheme of the present invention specifically is achieved in that
A kind of projector comprises projection module and opertaing device, and wherein, projection module is used to receive picture signal, and the output projection; Opertaing device is used to transmit control signal, it is characterized in that, this projector also comprises the electronic whiteboard module, described electronic whiteboard module is used for the control signal that receiving control apparatus sends, produce whiteboard images, and this whiteboard images and image from external image signal output apparatus input synthesized, synthesized image signal is exported to projection module.
Described electronic whiteboard module comprises: analog/digital converter (A/D), central processing unit (CPU), display chip, data-carrier store (RAM), program storage (ROM) and communication interface, described A/D is used to receive picture signal, and this signal is converted into digital signal, deliver among the CPU and handle; Described communication interface is used for the control signal that receiving control apparatus transmits, and this control signal is transmitted to the CPU processing; Described ROM links to each other with described CPU, is used for storage operating system, paint program, image synthesis program and constant data; Described CPU is used to carry out paint program and image synthesis program, and finishes data processing and system's control; Described RAM links to each other with described CPU, is used to store variable and ephemeral data; Described display chip is used to receive the data after CPU handles, and produces the demonstration output signal, and the demonstration output signal that produces is outputed to described projection module.
Described A/D links to each other with CPU by data bus, and described display chip links to each other with CPU by system bus, and described communication interface links to each other with CPU by serial ports.
Described opertaing device comprises: key moves up; Move down key; Be moved to the left key; Key moves right; The picture key; The erasing rubber key.
Described opertaing device is telepilot, keyboard or control panel.
A kind of method of utilizing described projector to realize the electronic whiteboard function is characterized in that this method is carried out the picture flow process and the image synthesis flow of whiteboard images simultaneously, and wherein the picture flow process of whiteboard images may further comprise the steps:
A1, read the positional information of mouse before moving;
After b1, mouse move, read current mouse location information, the mouse location information that reads before moving according to current mouse location information and mouse, straight line draws between these two mouse positions;
The image synthesis flow may further comprise the steps:
A2, pointwise are read whiteboard images and from the image of external image signal output apparatus input, if the value of whiteboard images is the value of whiteboard images background colour on current point, and execution in step b2 then; Otherwise, execution in step c2;
B2, composograph get from the image of the external image signal output apparatus input value at this point in the value of this point;
C2, composograph are got the value of whiteboard images at this point in the value of this point.
In step b1, described method of drawing straight line between two mouse positions is: the mouse location information that reads before moving according to current mouse location information and mouse, the graphical application DLL (dynamic link library) (API) of call operation system, straight line draws between two mouse positions.
The picture key is arranged on the opertaing device, when activating this picture key, begin described picture flow process and image synthesis flow, when activating this picture key once more, finish described picture flow process and image synthesis flow.
In described whiteboard images picture flow process, also comprise the erasing rubber function, realize that the erasing rubber function may further comprise the steps:
A, read the positional information of mouse before moving;
After b, mouse move, read the mouse current position information, the mouse location information that reads before moving according to current mouse location information and mouse will all be made as the value of whiteboard images background colour in the value of being had a few between these two mouse positions.
The erasing rubber key is arranged on the opertaing device, when activating this erasing rubber key, start the erasing rubber function, when activating this erasing rubber key once more, close the erasing rubber function.
Because projector of the present invention utilizes the opertaing device of self to realize the electronic whiteboard function, when carrying out Projection Display, utilize the opertaing device simulation paintbrush virtual electronic image that on projected image, draws, make the user use projection display apparatus demonstrate, when explaining, in projection, carry out operations such as some pictures, note, emphasis prompting quickly and easily, improve the practicality of projection display apparatus, and further increase work efficiency; Adopt the method for projector of the present invention and realization electronic whiteboard function thereof, not only can obtain more satisfactory picture effect, simultaneously to the user use which type of hardware, software as the Projection Display signal input sources without any requirement, make the user utilize projection display apparatus to carry out operations such as some demonstrations, explanation more easily better.
Description of drawings
Fig. 1 is the described system chart with projector of built-in electronic whiteboard module of the embodiment of the invention;
Fig. 2 is the structural drawing of the described electronic whiteboard module of the embodiment of the invention;
Fig. 3 is the picture process flow diagram of the whiteboard images of the described method of the embodiment of the invention;
Fig. 4 is the image synthetic schemes of the described method of the embodiment of the invention.
Embodiment
The present invention is further described in more detail below in conjunction with the drawings and specific embodiments.
In order to realize the function of projector's electronic whiteboard, the invention discloses a kind of electronic whiteboard module, this electronic whiteboard module can place within the projector, also can place outside the projector, Fig. 1 is the system chart with projector of built-in electronic whiteboard module, as shown in Figure 1, this projector 101 comprises electronic whiteboard module 102, projection module 103 and opertaing device 104, this electronic whiteboard module 102 receives the external image signal output apparatus, for example computing machine 105, the control signal that the picture signal of output and opertaing device 104 send, control signal is converted into whiteboard images, again this whiteboard images and image from computing machine 105 input are synthesized, send the shows signal of composograph to projection module 103; Described projection module 103 is the general projection module of common projector, is used for the picture signal projection output that will receive.If described electronic whiteboard module 102 places outside the projector, then described projection module 103 is common projector.Opertaing device 104 links to each other with electronic whiteboard module 102 by wired or wireless form, be used for transmitting control signal to electronic whiteboard module 102, opertaing device 104 can be telepilot, keyboard or control panel etc., and the opertaing device 104 of present embodiment is an Infrared remote controller.
Described electronic whiteboard module 102 is a hardware circuit board with certain computing ability, Fig. 2 is the structural drawing of the described electronic whiteboard module of present embodiment, as shown in Figure 2, this electronic whiteboard module 102 comprises: analog/digital converter (A/D) 201, central processing unit (CPU) 202, display chip 203, program storage (ROM) 204, data-carrier store (RAM) 205, communication interface 206, wherein:
The analog end of A/D201 links to each other with computing machine 105, digital end links to each other with CPU202 by data bus 208, is used for the picture signal of receiving computer 105 outputs, if this picture signal is a simulating signal, then the analog signal conversion that receives is become digital signal, and transfer to the CPU202 processing; If this picture signal is a digital signal, then A/D201 transfers to CPU202 with this digital signal and handles only as a path.This A/D201 can receive polytype signal, for example Video Graphics Array (VGA) signal, Digital Video Interactive (DVI) signal, video (Video) signal, composite video (Composite Video) signal, S terminal (S-Video) signal, low-voltage differential signal (LVDS) signal and aberration (YUV) signal etc.
CPU202 is connected with display chip 203 by system bus 209, be used to carry out paint program and image synthesis program, and finish functions such as data processing and system's control, the model of CPU202 can be NS GEODE, INTEL XCALE, PIXELWORDS etc. in the present embodiment.
ROM204 links to each other with CPU202, be used for stored programme and constant data, program wherein comprises paint program of the present invention and image synthesis program, and projector of the present invention carries out this paint program and image synthesis program by CPU202, thereby realizes the electronic whiteboard function.
RAM205 links to each other with CPU202, is used to store variable and ephemeral data.
Display chip 203 is used to receive the data after CPU202 handles, and the picture signal that is used to show output of the standard of generation, for example VGA signal, DVI signal, composite video (Composite Video) signal, S terminal (S-Video) signal, low-voltage differential signal (LVDS) signal and aberration (YUV) signal etc., and the picture signal that produces outputed to the projection module 103 of projection display apparatus, so that show by projection display apparatus.
Communication interface 206 is connected with CPU202 by serial ports 210, is used for the control signal that receiving control apparatus 104 transmits, and this control signal is transmitted to the CPU202 processing.In the present embodiment, communication interface 206 is the RS232 interface, and serial ports 210 is the RS232 serial ports.
In order to realize the picture function of electronic whiteboard module, the described telepilot 104 of present embodiment need have following function key: a, the key that moves up, and is used to the mouse that moves up; B, move down key, be used to move down mouse; C, be moved to the left key, be used to be moved to the left mouse; D, the key that moves right are used to the mouse that moves right; E, picture key are used to press the button once and then activate the picture function, at this moment by last, down, and a left side, the key that the moves right corresponding image that then can draw on display image presses the button once and then cancels the picture function; F, erasing rubber key: be used to press the button once and then activate the erasing rubber function, again by last, down, and a left side, the key that moves right then plays the function of erasing rubber, presses the function that this erasing rubber key is then cancelled erasing rubber once more.
The all unique correspondence of aforesaid each function key a key, when the user presses wherein certain function key, the control circuit of Infrared remote controller 104 just sends to communication interface 206 with the pairing key of this function key by infrared signal, communication interface 206 is forwarded to CPU202 with this key again, because the function key on key and the Infrared remote controller 104 is one to one, CUP202 calls the program of this key correspondence according to this key, realizes function corresponding.For example, when the user presses the picture key, the key of this picture key correspondence just is sent to CPU202, and CPU202 carries out corresponding program to realize the picture function.
Aforesaid electronic whiteboard module 102 has following major function:
Infrared remote controller 104 is equivalent to user's paintbrush, when projection display apparatus carries out Projection Display, the user utilizes the picture key of Infrared remote controller 104 to start the picture function, on utilizing again, down, the picture operation on screen is carried out on a left side, the mouse on the key control that the moves right screen, thereby is implemented in operations such as carrying out some notes or emphasis prompting on the projected image; When the user presses the erasing rubber key, start the erasing rubber function, utilize again, down, and a left side, the figure that the mouse on the key control that the moves right screen will draw originally wipes.
In order to realize above-mentioned function, embodiment of the present invention also discloses a kind of method that realizes the electronic whiteboard function, this method comprises two flow processs of carrying out simultaneously, and the picture flow process that flow process is a whiteboard images, this flow process can realize utilizing the opertaing device whiteboard images of drawing; Another flow process is the image synthesis flow, and the image of whiteboard images that this flow process is drawn the picture flow process and computing machine input synthesizes.The picture flow process of whiteboard images as shown in Figure 3, described picture flow process may further comprise the steps:
Step 301, judge whether to activate the picture key, if then execution in step 302; Otherwise, do not process;
Step 302, read the positional information of mouse;
If step 303 mouse moves, then read mouse location information again, according to current mouse location information and the mouse location information that read last time, the graphical application DLL (dynamic link library) (API) of call operation system, the straight line that between these two positions, draws, execution in step 304; Otherwise, direct execution in step 304;
Step 304, judge whether to activate the erasing rubber key, if then execution in step 305; Otherwise, execution in step 308;
Step 305, read the positional information of mouse;
Step 306, judge that whether mouse moves, if then execution in step 307, otherwise execution in step 308.
Step 307, read mouse location information, according to current mouse location information and the mouse location information that read last time, the figure API of call operation system will be made as the value of whiteboard images background colour in the value of being had a few between these two mouse positions;
Step 308, judge whether the user activates the erasing rubber key once more, if then execution in step 309; Otherwise, return step 305.
Step 309, judge whether to activate once more the picture key, if, process ends then; Otherwise, return step 302.
Meanwhile, the electronic whiteboard module is synthesized above-mentioned picture flow process whiteboard images of drawing and the image of importing from computing machine, shows to display module thereby form final image transfer, and as shown in Figure 4, the synthetic flow process of image comprises:
Step 401, judge whether to activate the picture key, if then execution in step 402; Otherwise, do not process;
The image that step 402, pointwise are read whiteboard images and imported from computing machine, if the value of whiteboard images is the value of whiteboard images background colour on current point, then execution in step 403; Otherwise, execution in step 404;
Step 403, composograph are got from the image of the computing machine input value at this point in the value of this point, and execution in step 405;
Step 404, composograph are got the value of whiteboard images at this point in the value of this point, and execution in step 405;
Step 405, judge whether image reads and finish, if then execution in step 406; Otherwise, return step 402;
Step 406, judge whether to activate once more the picture key, if, process ends then; Otherwise, return step 402.
Above-mentioned image synthesis flow utilizes Infrared remote controller 104 whiteboard images of drawing and the image of importing from computing machine to synthesize the user, and shows, thereby realizes the electronic whiteboard function of projector.
The above; only for the preferable embodiment of the present invention, but protection scope of the present invention is not limited thereto, and anyly is familiar with the people of this technology in the disclosed technical scope of the present invention; the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.

Claims (10)

1. a projector comprises projection module and opertaing device, and wherein, projection module is used to receive picture signal, and the output projection; Opertaing device is used to transmit control signal, it is characterized in that, this projector also comprises the electronic whiteboard module, described electronic whiteboard module is used for the control signal that receiving control apparatus sends, produce whiteboard images, and this whiteboard images and image from external image signal output apparatus input synthesized, synthesized image signal is exported to projection module.
2. projector as claimed in claim 1, it is characterized in that, described electronic whiteboard module comprises: analog/digital converter (A/D), central processing unit (CPU), display chip, data-carrier store (RAM), program storage (ROM) and communication interface, described A/D is used to receive picture signal, and this signal is converted into digital signal, deliver among the CPU and handle; Described communication interface is used for the control signal that receiving control apparatus transmits, and this control signal is transmitted to the CPU processing; Described ROM links to each other with described CPU, is used for storage operating system, paint program, image synthesis program and constant data; Described CPU is used to carry out paint program and image synthesis program, and finishes data processing and system's control; Described RAM links to each other with described CPU, is used to store variable and ephemeral data; Described display chip is used to receive the data after CPU handles, and produces the demonstration output signal, and the demonstration output signal that produces is outputed to described projection module.
3. projector as claimed in claim 2 is characterized in that described A/D links to each other with CPU by data bus, and described display chip links to each other with CPU by system bus, and described communication interface links to each other with CPU by serial ports.
4. projector as claimed in claim 1 is characterized in that, described opertaing device comprises: key moves up; Move down key; Be moved to the left key; Key moves right; The picture key; The erasing rubber key.
5. projector as claimed in claim 1 is characterized in that, described opertaing device is telepilot, keyboard or control panel.
6. a method of utilizing projector as claimed in claim 1 to realize the electronic whiteboard function is characterized in that this method is carried out the picture flow process and the image synthesis flow of whiteboard images simultaneously, and wherein the picture flow process of whiteboard images may further comprise the steps:
A1, read the positional information of mouse before moving;
After b1, mouse move, read current mouse location information, the mouse location information that reads before moving according to current mouse location information and mouse, straight line draws between these two mouse positions;
The image synthesis flow may further comprise the steps:
A2, pointwise are read whiteboard images and from the image of external image signal output apparatus input, if the value of whiteboard images is the value of whiteboard images background colour on current point, and execution in step b2 then; Otherwise, execution in step c2;
B2, composograph get from the image of the external image signal output apparatus input value at this point in the value of this point;
C2, composograph are got the value of whiteboard images at this point in the value of this point.
7. method as claimed in claim 6, it is characterized in that, in step b1, described method of drawing straight line between two mouse positions is: the mouse location information that reads before moving according to current mouse location information and mouse, the graphical application DLL (dynamic link library) (API) of call operation system, straight line draws between two mouse positions.
8. method as claimed in claim 6 is characterized in that, the picture key is arranged on the opertaing device, when activating this picture key, begin described picture flow process and image synthesis flow, when activating this picture key once more, finish described picture flow process and image synthesis flow.
9. method as claimed in claim 6 is characterized in that, in described whiteboard images picture flow process, also comprises the erasing rubber function, realizes that the erasing rubber function may further comprise the steps:
A, read the positional information of mouse before moving;
After b, mouse move, read the mouse current position information, the mouse location information that reads before moving according to current mouse location information and mouse will all be made as the value of whiteboard images background colour in the value of being had a few between these two mouse positions.
10. method as claimed in claim 9 is characterized in that, the erasing rubber key is arranged on the opertaing device, when activating this erasing rubber key, starts the erasing rubber function, when activating this erasing rubber key once more, closes the erasing rubber function.
CNB2003101212610A 2003-12-15 2003-12-15 Projector and method for implementing electronic whiteboard function thereof Expired - Fee Related CN100399184C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2003101212610A CN100399184C (en) 2003-12-15 2003-12-15 Projector and method for implementing electronic whiteboard function thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2003101212610A CN100399184C (en) 2003-12-15 2003-12-15 Projector and method for implementing electronic whiteboard function thereof

Publications (2)

Publication Number Publication Date
CN1629719A CN1629719A (en) 2005-06-22
CN100399184C true CN100399184C (en) 2008-07-02

Family

ID=34844130

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2003101212610A Expired - Fee Related CN100399184C (en) 2003-12-15 2003-12-15 Projector and method for implementing electronic whiteboard function thereof

Country Status (1)

Country Link
CN (1) CN100399184C (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682637A (en) * 2012-05-05 2012-09-19 山东长征教育科技有限公司 Omnibearing interactive wired teaching system
CN103226409A (en) * 2012-10-19 2013-07-31 无锡海森诺科技有限公司 Method for achieving electronic whiteboard function switching and based on shortcut key icons, and electronic whiteboard
CN103019437A (en) * 2012-10-29 2013-04-03 苏州大学 Touch type electronic whiteboard
CN108230661B (en) * 2018-02-09 2024-05-17 广州视源电子科技股份有限公司 Infrared remote control system, method, infrared electronic whiteboard and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1374583A (en) * 2001-03-12 2002-10-16 掌幄科技股份有限公司 Instant interactive meeting system comprising portable device group
JP2003233462A (en) * 2002-02-12 2003-08-22 Seiko Epson Corp Drawing auxiliary system, image printing system, drawing auxiliary program and image printing program, as well as drawing auxiliary method and image printing method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1374583A (en) * 2001-03-12 2002-10-16 掌幄科技股份有限公司 Instant interactive meeting system comprising portable device group
JP2003233462A (en) * 2002-02-12 2003-08-22 Seiko Epson Corp Drawing auxiliary system, image printing system, drawing auxiliary program and image printing program, as well as drawing auxiliary method and image printing method

Also Published As

Publication number Publication date
CN1629719A (en) 2005-06-22

Similar Documents

Publication Publication Date Title
CN106723987B (en) Intelligent platform
CN103440116B (en) A kind of interactive electronic demonstration system
US6922202B2 (en) Image display apparatus and method, information processing apparatus using the image display apparatus, and storage medium
CN113504852A (en) Control method of recording and broadcasting integrated intelligent comprehensive screen blackboard system
CN102722336A (en) Office wireless speaking system and synchronous tracking method for synchronous tracking of editing and demonstration operation
TW201234197A (en) Portable data processing system and signal input/output device thereof
JP2002118738A5 (en) Image display device and method, and storage medium
CN102109971A (en) Slide projector showing system capable of wirelessly transmitting plotting information
CN108805766B (en) AR somatosensory immersive teaching system and method
CN103150932A (en) Video real object displaying system and method with network function
CN106125928A (en) PPT based on Kinect demonstrates aid system
CN100399184C (en) Projector and method for implementing electronic whiteboard function thereof
US20230409192A1 (en) Device Interaction Method, Electronic Device, and Interaction System
CN103929602A (en) Recordable display device
KR101849036B1 (en) Apparatus for converting hybrid language display mode by caption scan in moving picture
CN102736378B (en) Projection apparatus and projection method
CN103543829A (en) Intelligent 3D (three-dimensional) visual presenter capable of realizing projection touch
CN103631401A (en) Portable interactive projection equipment and method
TW202016904A (en) Object teaching projection system and method thereof
CN203608279U (en) Miniature projector
US20150351144A1 (en) Wireless transmission apparatus and implementation method thereof
CN101963749B (en) Portable multimedia projector
CN209980227U (en) Intelligent display system and device
KR20230085333A (en) Apparatus for ai based children education solution
CN107239246A (en) A kind of picture synchronous display method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080702

Termination date: 20201215

CF01 Termination of patent right due to non-payment of annual fee