WO2012056459A1

WO2012056459A1 - An apparatus for education and entertainment

Info

Publication number: WO2012056459A1
Application number: PCT/IL2011/000839
Authority: WO
Inventors: Arie Ben Zvi
Original assignee: Visionstory Ltd
Priority date: 2010-10-28
Filing date: 2011-10-26
Publication date: 2012-05-03

Abstract

A method for education and entertainment using a multimedia apparatus are disclosed wherein an image sensor capture images that are grabbed by an image signal processor for object detection and recognition (Such as faces, colors, numbers, etc...), a microphone capture voice and sound inputs, where the processor process it to data. The processor analyzes the input data and the apparatus output a multimedia sound to speakers and display device. The output is related to the detected objects in the image and the sound detection. The multimedia apparatus is used for education and entertainment.

Description

AN APPARATUS FOR EDUCATION AND ENTERTAINMENT

This application claims the benefit of US Provisional Application No 61/407,471 filed on Oct. 28, 2010 entitled "A method and apparatus for education and entertainment", Incorporated herein in its entirety.

Field of the Invention

A method and apparatus for education and entertainment comprising image and voice features, using a multimedia apparatus for capturing visual and sound objects in learners' surrounding.

Background

The following description relate to a method of education and entrainment using a multimedia apparatus that receives image and voice inputs, processes the received data and outputs voice or visual message for the purpose of education and entertainment.

Traditional education in whatever technology used has as its basic object to educate. It uses a lecture-based model to transfer content to the learner. During the lecture, the material is presented verbally, often with the help of visual, audio, textual and other such aids. In advanced technologies the educational process is consciously interactive; the learner is aware of the learning process and takes active part in it. The concept of this new invention is to educate while playing or while being engaged in other activities. Over the past three decades numerous studies in English-speaking countries have pointed out the advantages of involving the entire family surrounding young children in the teaching process, especially when it comes to learning languages or widen their spoken vocabulary.

The researches pointed out the role played by young siblings close in age in each others' literacy development and argue for a unique reciprocity in learning between older and younger children. Thus it steps outside hitherto recognized paradigms of 'scaffolding' and 'collaborative learning'. This reciprocity of learning is referred to as a synergy whereby siblings act as adjuvant, stimulating and fostering each others' development.

("Sisters and Brothers as Language and Literacy Teachers: Synergy between Siblings Playing and Working Together", Eve Gregory)

Summary of the Invention

The object of this invention is to provide a multimedia apparatus comprising image and voice features for the education and entertainment of learners of all ages, babies, youngsters, kids and adults.

The apparatus captures visually objects and sounds in learners' surrounding; Data is processed for objects and sounds detection and recognition. The apparatus outputs a multimedia expression. The multimedia expression comprises of voice and/or display device. The output expression is corresponding to the image and voice data processed based on current and previous recorded data and expressions.

The objects in learner's surrounding may be illuminated by the apparatus.

The multimedia education and entertainment apparatus may be in a form of a toy, a robot, a doll, a wristwatch, etc...

The apparatus comprises an image sensor (Camera, CCD or CMOS image sensor, Video stream) input for image stream and a microphone input for voice stream. The apparatus may comprise of a light source that illuminates the area in the field of view of the image sensor and improves scene condition in low light environment.

The multimedia output comprises of speakers for voice output and display device. A processing unit capable of processing images and voice, a storage memory (Flash) and RAM memory (SDRAM, DDR, DDR II ...) it may comprise of a connection to an external computer, a connection to a network and the web, an interface unit and external memory interface.

In accordance with one aspect of the invention, the multimedia education and entertainment apparatus may be in a form of a Personal Computer (PC), mobile phone, Tablet computer comprising of a camera (web cam) and microphone. Wherein the image and voice processing take place on the device processor utilizing the camera, Microphone, Display and speakers connectivity.

The image processing may detects and recognizes an object, and/or an object characteristic, a barcode a pattern and other visible characteristics that are integrated, attached or affixed to an object.

In yet another aspect of the invention, the multimedia education and entertainment apparatus may be used for education and learning of objects such as letters, words, numbers, mathematical calculation, colors, geometrical shapes, fruits, vegetables, pets, animals, etc. In yet another aspect of the invention, the multimedia education and entertainment apparatus may be used for learning of new languages, making the multimedia output expression in different languages.

In yet another aspect of the invention, the multimedia education and entertainment apparatus may be used for playing music, by detection of musical instruments, Bands and Artists etc, and outputting multimedia music expression.

In yet another aspect of the invention, the multimedia education and entertainment apparatus may be used for games and entertainment.

The apparatus may comprise of a light source. The light will illuminate the objects that are in the field of view of the image sensor. This will help the learner to find the objects the apparatus is pointing to. The light source may also be used as a tool to point the image sensor to a certain point of interest to find the object that the learner or the accompanying adult likes the apparatus to detect. The light source may be used to improve the light condition in low light environment; this will enable better performance of the image sensor in dark scene. In yet another aspect of the invention, a play board with accessory may be used with the apparatus; it will comprise a board and pieces that may be attached by magnet or any other solution. The pieces may include letters, words, numbers, fruits, vegetables, pets and any other object. In yet another aspect of the invention, the play board may be part of the apparatus and the SW in the apparatus has the capability of detection and recognition of pieces placed on the play board. The apparatus will detect the play board when it is in the field of view of the image sensor and may notify the learner by sound or by a light LED.

In yet another aspect of the invention, the apparatus may comprise a LED that will notify the learner that the play board is visible and that the apparatus is ready to detect objects placed on the board. The LED for example may be in a red color when the play board is not detected and change to green when the play board is detected and the apparatus is ready to detect.

The multimedia education and entertainment apparatus may be used both for education and entertainment, outputting educational and entertainment multimedia expressions.

The multimedia apparatus may have the capability to update, upgrade, and add new application and content to the apparatus.

Detailed description of the invention

In one general aspect of the invention a multimedia education and entertainment apparatus comprises a camera image sensor for image stream input, a microphone for voice stream input, a light source to illuminate the objects, a Processing and control platform capable of image signal processing of the images captured by the image sensor and voice signal processing of the microphone input. The Processing and control platform processes the input images stream for objects and colors detection and recognition from the images, and sounds, letters, words, sentences and any verbal detection and recognition from the sounds captured by the microphone.

The processed data is stored in memory with the history of previous detected data.

The Processing and control platform processes and calculates the output expression based on the new image and voice processed data and may comprise the previous history data to determine the multimedia output expression. W

The multimedia expression may be output thru speakers and display device.

The Processing and control platform may comprise of one or more processors for image stream processing and voice stream processing.

In yet another aspect of the invention, the image object detection identification and recognition may comprise of faces detection and recognition, emotions, face tracking, letters, words, numbers, math calculation, geometrical shapes, colors, fruits, vegetable, pets and any other shapes captures by the image sensor.

The image processing comprises various methods to detect and recognizes objects, The detection may comprise one or more methods of object detection, a barcode reading, a pattern detection and other visible characteristics detection that are integrated, attached or affixed to the object.

In yet another aspect of the invention, the voice detection identification and recognition may comprise of Letters, words, sentences, sounds, phonics and pronouncing, tones and any other voice captures by the microphone. In yet another aspect of the invention, the multimedia education and entertainment apparatus may also be interactive with the learner comprising learning activities, questions answering, riddles solving, Challenging, Finding, Counting, Story telling, games and entertainment.

The multimedia apparatus may comprise all or part of the input and output devices, such combination for example:

Microphone Speakers

Microphone Display device

Microphone Speakers and Display device

Image Sensor and Microphone Speakers

Image Sensor and Microphone Display device

Image Sensor and Microphone Speakers and Display device

The multimedia education and entertainment apparatus may be in a form of stand alone embedded electronic platform wrapped by a user friendly housing, preferred a toy, a robot, a doll etc,. The apparatus may be in other form as a Personal Computer (PC), Notebook, Net book, mobile device, mobile phone, PDA, tablet, wristwatch, MP3 player, MP4 player etc.

Detailed Description of drawings

Exemplary implementation of the present inventive concept is better described with reference to the accompanying drawings.

Figs 1A-1E - Illustrate the educational and entertainment apparatus HW.

FIG 1A the education and entertainment apparatus may comprise an image sensor (100) for image stream input, a microphone (102), a speaker (106), a display device (108), image and voice processing platform (120). The apparatus may comprise a light source (104). The apparatus has housing (141) to make it in a toy or any other user friendly shape.

FIG IB - In yet another aspect of the invention, the education and entertainment apparatus may comprise of image sensor (100), microphone (102), speaker (106), connected to a Personal Computer (122). The Display device is the Personal. Computer (122) monitor. The apparatus may comprise a light source (104). The Personal computer may be in the form of a Desktop, Laptop, Notebook, Net book etc.

FIG 1C - In yet another aspect of the invention, the education and entertainment apparatus may comprise of a laptop computer (Also refer as Net book computer, Notebook computer) (124). The input device image sensor (100) and microphone (102) and output device speakers (106) and display device (108) may be built-in in the laptop computer (124). The input/output devices (Image Sensor (100), Light Source (104), Microphone (102), Speakers (106), and Display device (108)) may be connected externally thru USB or any other input interface. FIG ID - In yet another aspect of the invention, the education and entertainment apparatus may comprise of a mobile phone (126). The input device image sensor (100) and microphone (102) and output devices speakers (106) and display device (108) are built-in in the mobile phone (126). The input/output devices (Image Sensor (100), Light Source (104), Microphone (102), Speakers (106), and Display device (108)) may be connected externally thru USB or any other input interface.

FIG IE - In yet another aspect of the invention, the education and entertainment apparatus may comprise of a Tablet Touchpad (128). The input device image sensor (100), microphone (102), output devices speakers (106) and display device (108) are built-in in the Touchpad (128). The input/output devices (Image Sensor (100), Light Source (104), Microphone (102), Speakers (106), and display device (108)) may be connected externally thru USB or any other input interface.

The education and entertainment apparatus may comprise of all the above input and output components or part of the components.

Fig 2 - In yet another aspect of the invention, fig. 2 shows the multimedia education and entertainment apparatus ecosystem. The environment of the education and entertainment apparatus (140, 142) may comprise of apparatus HW (142) appliance housing (140), objects and colors (160, 162, 164 and 166) to detect identification and recognition by image sensor (100), a learner (110) and a voice and sound (114) issued by the learner and a voice and sound from environment (116). The voice and sound are captured by Microphone (102). The speakers (106) issue the apparatus output voice and sound (118).

Learner (110) may be a baby, a youngster, a child or adult, preferable a baby or a young kid. There may be more than one learner (110) at the same time. Apparatus HW (142) comprises electronics components Image sensor (100), light source (104), microphone (102), processing platform (120), speakers (106) and display device (108).

In yet another aspect of the invention, Apparatus HW (142) may be placed inside an appliance housing (140). The appliance housing (140) may be in any form of a toy a robot a doll etc.

The electronic components may be placed in the appliance in different location, for example the processing platform (120) board may be placed internally (144), and the image sensor (100) may be placed in appliances' (146) eyes, e.g.

The image sensor (100) has a field of view (130), it is the area that is visible by image sensor (100). The light source (104) illumination area (132) illuminates the area pointed by the image sensor (100). The light source illuminates objects (160, 162, 164, and 166) that are captured by image sensor (100).

The illuminated area (132) enable the learner (110) to focus on the area and objects the apparatus (140, 142) has detected and notified. The light source area (132) is overlapping the image sensor's field of view area (130).

The education and entertainment apparatus HW (142) detects objects (160, 162, 164 and 166) seen by the image sensor (100), detects the voice data (114 and 116) and issues a multimedia expression to learner (110) by sound from speakers (106) and / or on display device (108). In yet another aspect of the invention, the expression is of a suitable type to educate and entertain the learner by issuing a related and adapted expression for specific learner (age, level etc.) to the detected identification and recognition objects colors and voice. In yet another aspect of the invention, the education and entertainment apparatus (140, 142) multimedia expression may be in various languages for learning of new language.

In yet another aspect of the invention, the education and entertainment apparatus (140, 142) may process and issue an expression for mathematical exercise, letters, words and sentence reading. The input image and voice data is processed by the processing platform (120) and output the expression thru speakers (106) and on display device (108).

In yet another aspect of the invention, the education and entertainment apparatus (140, 142) may issue a musical expression (118), the input image and voice data is processed by the processing platform (120) for detecting of musical instruments, bands and artists, musical logo's, musical names etc and output the expression thru speakers (106) and on display device (108).

If a blue square (162) is located in image sensor's (100) field of view (130) the image is captured by image sensor (100), processed by processing platform (120) and a multimedia expression notifies that a Blue square (162) was detected. The speaker (106) outputs a voice sound. Therefore the presented disclosure can provide interest and curiosity to the learner (110) to enhance the education of the learner.

Figs 3A-3G give samples of objects that may be detected and recognized Fig 3A the education and entertainment apparatus is capable of detecting and recognizing geometric shapes (161).

The apparatus is capable of detecting 3D objects such as Box, Cylinder etc ... The apparatus is capable of detecting colors.

Fig 3B the education and entertainment apparatus is capable of detecting regular letters and capital letters.

The letters detection and recognition supports letters in various languages.

Fig 3C the education and entertainment apparatus is capable of detecting numbers and mathematical signs (+-/x=) Fig 3D the education and entertainment apparatus is capable of detecting mathematical calculation. The apparatus may be used to help kids with mathematical exercise.

In yet another aspect of the invention, the kid places the math exercise while the apparatus is reading the numbers and signs and when an equal sign is detected (=) the apparatus will notify the results. Another method is that the apparatus follows kid's exercise and notifies him if the answer is correct or wrong.

Fig 3E the education and entertainment apparatus is capable of detecting words and sentences. The apparatus may be used to help kids with spelling and grammar exercise.

In yet another aspect of the invention, the kid places words on a board and the apparatus will check the spelling and notify correct word spelling or mistakes.

The apparatus checks grammars and sentences correctness.

Fig 3F + Fig 3G the education and entertainment apparatus is capable of detecting and recognizing objects such as vegetables, fruits, pets, furniture, symbols, cars, musical instruments, movie's figures, science, etc ...

Figs 4A-4C illustrates face detection recognition and emotion recognition.

In yet another aspect of the invention, the education and entertainment apparatus is capable of detecting faces. The apparatus supports the detection of one or more faces.

The apparatus uses the information from the face detection process to issue an entertaining output expression.

The apparatus comprises a face recognition detector. The face recognition is checking the faces detected in the image with the apparatus face detector to determine if a face is recognized.

The apparatus uses the information from the face recognition process to issue an entertaining output expression, for example identifying the person by his name.

In yet another aspect of the invention, as shown in Fig 4C, the education and entertainment apparatus is capable of emotion recognition reflected by a person's facial expressions, e.g. Happy face (182), Smiling face (182), Sad face (184), Surprise face (186), Sleepy face (188), Pouting, Winking etc ...

The apparatus supports emotion recognitions of one or more persons.

The apparatus uses the information from the emotion recognition process to issue an entertaining output expression.

Figs 5: Education and Entertainment apparatus electronic components

The education and entertainment apparatus comprises of an image sensor (100) to capture an image stream of images that are in the field of view of the image sensor, a light source (104) to illuminate the area in the field of view of the image sensor (100), a microphone (102) to capture sound and voice, speakers (106) for output of verbal and sound expression, a display device (108) for output of multimedia expression on the display.

A Processing platform (120) comprises a Processor controller (200) for processing images received form the image sensor (100), processing voice received from the microphone (102) processing output expression and control the apparatus operation, storage memory (206) for storing program code, database to support image and voice recognition and output database, a temporary memory (208) for storing data, objects, voice and history and multimedia output unit (210) for output expressions. An External Memory Interface (209) used for connectivity with External Memory (211). The external Memory (211) may be in a form of a cassette, Memory card, Flash card, Optical disk etc., it may be placed in a cartridge incorporated into the apparatus. When external Memory (211) is mounted, the external memory interface (209) operates so as to enable access to a program and data in the external Memory (211) at all times. The external Memory (211) comprises a ROM (Read Only Memory) and a RAM (Random Access Memory) memories. In the ROM, a program code and data are stored when the external Memory (211) is produced. The External Memory (211) comprises of a memory unit, ROM and RAM, which stores a program and data used by the processor .It enables adding of new applications, features and content to the education and entertainment apparatus. An interface unit (215) comprises a plurality of function buttons and switches for instructing the processor with user requests by pressing the buttons as needed and LED's for processor indication to the user. The interface unit (215) sends an operation signal received from the User to the processor, For example, Power On/Off, Level selection, Volume control, etc ...

A personal computer interface (212) used for connectivity with external Personal computer (216). The connectivity is thru a standard interface (214), preferred a USB interface. This will enable the connection of the external personal computer (216) to the education and entertainment apparatus for the purpose of data transfer, images display on the personal computer, SW, firmware and contents updates.

The Processing controller (200) may comprise of one or more processing components. It comprises of an Image Signal processing (202) and voice processing (204). The image and voice processing is implemented in SW and HW.

The image sensor (100) may comprise an image sensor processor integrated in the image sensor, for pre-processing of the image to transfer the optical data captured by the image sensor pixels to a more usable image data.

The Light sensor (104) may be connected and controlled by, either the image sensor (218), or the Processor Controller (200).

The multimedia output expression may be voice notification, music, or any other sound effect. It support a multi language audio to speakers (106).

Another output expression is a display device (108) using text, video or screen effects.

Fig 6 is a flowchart of processing and outputting a multimedia expression Fig 6 shows a flowchart of a method for processing of image and voice inputs and output of multimedia expression corresponding to the input processed data.

Where the system starts in initialization of the HW and SW (500), an image is captured (502) by the image sensor (100), the image is than processed (504) and object detection and recognition is processed (506). The object may be a face, emotion, letters, numbers, shapes, fruits, colors, etc ...

This process is of image capture (502), Image processing (504) and Object Detection and recognition (506) is running continuously. After completing the object detection and recognition (506) it returns to Image capture (502) to process new input image data.

A voice is captured (512) then the voice data is processed (514) and then Letters, words, sentences, phonics, tones, pronouncing, and sound detection and recognition (516). The process is of voice capture (512), Voice processing (514), and Voice Detection and recognition (516) is running continuously. After completing voice detection and recognition (516) it returns to voice capture (512) to process new input voice data.

The output of the Object detection and Recognition (506) and the Voice detection and recognition (516) is processed by the expression processing unit (520). The preferred multimedia output (522) is Audio system speakers (106) and a display device (108).

The expression processing (520) is running continuously, receiving new data from the Object detection and recognition (506) and from the voice detection and recognition (516).

Fig 7: The multimedia education and entertainment apparatus with a play board

Fig 7 shows another aspect of the invention, as explained in Fig 2 when apparatus comprises of a play board (158).

The play board may be in a formation of a black board, white board a magnetic board.

The play board (158) comes with accessories (159) that can be attached to the board, the accessories comprise of ABC letters, numbers, signs, images of animals, fruits, vegetables, colors, geometrical shapes and other objects. Play board (158) can be written on with a standard writing device: a Pen, chalk, marker etc ...

The play board may be in a formation of an electronic monitor, the accessories may be displayed on the monitor. Play board (158) may be part of the apparatus.

The Image processing algorithm within the education and entertainment apparatus HW (142) is capable to detect and recognize the accessories (159) that are attached to play board (158).

The apparatus is capable to detect hand writing and additional accessories that are not part of the apparatus package;

The apparatus HW (142) detects that play board is in field of view (130) of the image sensor (100).

In yet another aspect of the invention, the apparatus (140, 142) comprises of a play board (158), a detection notification method using sound (118) and light LED (109). For example light LED (109) is in red color when play board (158) is not detected at all or is not fully in image sensor's range (130) or partial detected by the image sensor (100). Said light LED (109) changes to green when play board (158) is in range (130) and apparatus is ready to detect accessories placed on play board (158). The light LED colors are an example only and can be change according to the application.

The learner's (110) may hold object in his hands and place them on play board (158).

The learner's (110) may hold the apparatus in his hands or positioned the apparatus in front of play board (158). Light LED (109) indicates to learner the correct poison of the apparatus (140, 142). When the light LED is red the apparatus needs to be repositioned and when the light LED is green the apparatus is positioned correctly.

When learner (110) places accessories (159) on play board (158), the apparatus (140, 142) processes the images received from image sensor (100) and issues a multimedia output expression thru speakers (106) and display device (108). Learner (110) may place words and sentences on the play board (158) using letters accessories (159), apparatus (140, 142) processes the images received from image sensor (100) analyzes the spelling syntax and grammar and issues a multimedia output expression. The learner (110) may place numbers and signs on the play board (158) using numbers accessories (159), making mathematical exercise, apparatus (140, 142) processes the images received from image sensor (100) analyze the spelling syntax and grammar and issues a multimedia output expression.

The learner may hand write letters, words or draw objects on the play board (158), apparatus (140, 142) processes the images received from image sensor (100) and issues a multimedia output expression.

The Learner (110) may place musical accessories (159) on the play board (158), the accessories (159) are in a form of a musical instruments, bands and artists images, musical bands and artists logos and names etc The apparatus (140, 142) processes the images received from the image sensor (100) detects the musical accessory object and issues a musical output expression. The apparatus (140, 142) may detect multiple musical accessories (159) and may issue an output expression that is a combination of the musical accessories (159), for example, detection of Piano and Violin, The output expression will be a musical melody of both instruments. The apparatus (140, 142) may detect multiple musical accessories (159) and may issue an output expression in various methods, for example detection of multiple bands and artists and issue a musical song for each of them in random/shuffle orders.

The apparatus may comprise of a light source (104). The light source illuminates area (132) pointed by the image sensor (100). The light source illuminates play board (158). This method helps the learner to align the apparatus (140, 142) in the right position to play board. In addition the light source improves the visibility in low light conditions. The apparatus is capable of detecting the play board (158) without a light source.

The apparatus (140, .142) may comprise an alignment facility. The apparatus (140, 142) and the play board (158) may be placed on a special facility that will place the apparatus (140, 142) and the play board (158) in a fixed alignment, location and distance between them. The positioning of the apparatus and the play board (158) will place the play board (158) in the field of view (130) of the image sensor (100). The apparatus (140, 142) and the play board (158) may be portable and can be placed in or pull out from the alignment facility. The alignment facility may comprise a power supply to the apparatus.

Fig 8A-D: The multimedia education and entertainment apparatus may be in any formation. Fig 8 gives some examples for better understanding the possibilities. Fig 9: The multimedia education and entertainment apparatus external interface to a personal computer

The multimedia education and entertainment apparatus comprises of an external interface (214) to a Personal computer (216). The external interface may be any Personal computer interface standard comprising USB (Universal Serial Bus 2/3), Serial interface, Parallel interface, FireWire, eSata, PCI-E, HDMI, DVI, Ethernet (1D/100/1000M) etc. The preferred interface, but not limited to, is a USB interface.

The external interface with the Personal computer may be a wireless communication interface, comprising of a WiFi (802.11a/g/n WiFi), Bluetooth and Cellular network.

The personal computer interface (214) may be connectivity to a network and the web. The connectivity is thru a standard interface with a cable or a wireless connectivity interface, preferred a WiFi connectivity or a Cellular connectivity. This will enable to the education and entertainment apparatus to connect directly to the web.

The external interface connectivity between the education and entertainment apparatus and the Personal Computer enables to transfer data between the devices.

The external interface is used to enhance the multimedia and entertainment apparatus features and capabilities. It comprises of the following features extensions examples:

• Display images captured by the apparatus on the Personal computer Real-time image preview on the personal computer

A dedicated SW running on the Personal computer to configure and change settings of the education and entertainment apparatus.

Connect the education and entertainment apparatus to the web, where it can connect to a website for various purposes.

Enable online upload of multimedia expression from a PC or from the web while the apparatus is running and issuing the multimedia expression received online from the external interface to the user.

Update and upgrade the education and entertainment apparatus SW and firmware.

Add new applications, features and contents to the education and entertainment apparatus.

Support the apparatus features, for example support the face recognition feature by capturing face images of a person, view it on the Personal computer and transfer the data to the apparatus to store the face data in its database.

Claims

What is claimed:

1. An apparatus for education and entertainment comprising image and voice features, multimedia applications for capturing visual objects and sound in the surrounding;

2. The apparatus of claim 1 wherein image and voice inputs are received, data processed for object and sound detection and recognition, and outputs voice and/or visual expression based on current and previous recorded data and expressions.

3. The apparatus of claim 1 comprising a light source, controlled by processor and/or image sensor pointing at objects of interest.

4. The apparatus of claim 1 comprising an image sensor and microphone inputs;

5. The apparatus of claim 1 comprising a speaker and display device outputs;

6. The apparatus of claim 1 comprising multimedia output and display device in different languages.

7. The apparatus of claim 1 comprising processing unit for images and voice, a storage memory, an external interface unit including memory, a connection to external computer, to a network, to the web.

8. The apparatus of claim 1 may be in a form of a personal computer, mobile phone, Tablet computer, comprising of a camera (web cam), microphone, speakers and display.

9. The apparatus of claim 1 comprising of a processing unit for detection of musical instruments, recognition of Bands, artists and outputting multimedia music expression.

10. The apparatus of claim 1 comprising a play board with accessories to be detected and recognized by image sensor, may be pointed at by light source and notify its existence by sound and/or light LED.

11. The apparatus of claim 1 being in any form e.g., a toy, robot, doll, wristwatch, etc.

12. The apparatus of claim 1 is capable of updating, upgrading and adding new application and content.