US10528619B2 - Image display method and device - Google Patents
Image display method and device Download PDFInfo
- Publication number
- US10528619B2 US10528619B2 US14/904,503 US201414904503A US10528619B2 US 10528619 B2 US10528619 B2 US 10528619B2 US 201414904503 A US201414904503 A US 201414904503A US 10528619 B2 US10528619 B2 US 10528619B2
- Authority
- US
- United States
- Prior art keywords
- images
- image
- electronic device
- displayed
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/532—Query formulation, e.g. graphical querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G06K9/00228—
-
- G06K9/00288—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/161—Indexing scheme relating to constructional details of the monitor
- G06F2200/1614—Image rotation following screen orientation, e.g. switching from landscape to portrait mode
-
- G06K9/00362—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
Definitions
- Various embodiments of the present invention relate to an electronic device, and more particularly, to a method and apparatus for displaying images.
- GUI Graphic User Interface
- a mobile device can store basic applications developed by the mobile device's manufacturing company and installed therein, and additional applications downloaded from application sales web sites through the Internet, and execute the applications.
- the additional applications may have been developed by general developers and then registered in the application sales web sites.
- many electronic devices including the mobile device are also providing various kinds of image viewer applications for displaying stored images such as pictures on a screen so that a user can view the stored images.
- Stored images may include images that a user does not want to view.
- image display methods according to the related art sequentially display all images included in a selected category on a screen, the user has no choice but to view images that he/she does not want to view.
- Various embodiments of the present disclosure provide a method and apparatus for enabling a user to select one or more images including a specific object from among a plurality of images to view the selected images, in an electronic device.
- an apparatus of displaying an image through recognition of an object displayed on a screen of an electronic device including: a storage unit configured to store a plurality of image files; a display unit configured to display an image corresponding to each image file stored in the storage unit on a screen of the electronic device, and to convert the displayed image to another image stored in the storage unit according to an input by input means or setting of an automatic screen conversion function to display the converted image; and a controller configured to prevent, if a specific object included in the image displayed on the screen is selected, images not including the selected object among images of the plurality of image files stored in the storage unit from being displayed on the display unit.
- the display unit may display, on a screen, function selecting means for executing a function for preventing the images not including the selected object from being displayed on the display unit.
- the function selecting means may be in the form of a menu window including a function selection menu for at least one function related to processing of an image displayed on the display unit.
- the specific object included in the image displayed on the screen may be selected when a specific area in the image is selected by input means to select at least one object included in the selected area.
- the specific object included in the image displayed on the screen may be selected when one or more objects included in the image displayed on the screen are detected, areas of the detected objects are displayed on the image, and an area is selected from among the displayed areas of the detected objects.
- the selected object may be a human's face.
- an apparatus of displaying an image through recognition of an object displayed on a screen of an electronic device including: a storage unit configured to store a plurality of image files; a display unit configured to display an image corresponding to each image file stored in the storage unit on a screen of the electronic device, and to convert the displayed image to another image stored in the storage unit according to an input by input means or setting of an automatic screen conversion function to display the converted image; and a controller configured to prevent, if a specific object included in the image displayed on the screen is selected, images including the selected object among images of the plurality of image files stored in the storage unit from being displayed on the display unit.
- the display unit may display, on a screen, function selecting means for executing a function for preventing the images including the selected object from being displayed on the display unit.
- the function selecting means may be in the form of a menu window including a function selection menu for at least one function related to processing of an image displayed on the display unit.
- the specific object included in the image displayed on the screen may be selected when a specific area in the image is selected by input means to select at least one object included in the selected area.
- the specific object included in the image displayed on the screen may be selected when one or more objects included in the image displayed on the screen are detected, areas of the detected objects are displayed on the image, and an area is selected from among the displayed areas of the detected objects.
- the selected object may be a human's face.
- a method of displaying an image through recognition of an object displayed on a screen of an electronic device including: displaying an image corresponding to each image file of a plurality of image files stored in a storage unit, on a screen of the electronic device; selecting a specific object included in the image displayed on the screen; and converting the displayed image to another image stored in the storage unit according to an input by input means or setting of an automatic screen conversion function, and displaying the converted image, wherein the displaying of the converted image includes preventing images not including the selected object among images of the plurality of image files stored in the storage unit from being displayed on the display unit.
- the method may further include, after the specific object is selected, displaying, on a screen, function selecting means for executing a function for preventing images not including the selected object from being displayed on the display unit.
- the function selecting means may be in the form of a menu window including a function selection menu for at least one function related to processing of an image displayed on the display unit.
- the specific object included in the image displayed on the screen may be selected when a specific area in the image is selected by input means to select at least one object included in the selected area.
- the specific object included in the image displayed on the screen may be selected when one or more objects included in the image displayed on the screen are detected, areas of the detected objects are displayed on the image, and an area is selected from among the displayed areas of the detected objects.
- the selected object may be a human's face.
- a method of displaying an image through recognition of an object displayed on a screen of an electronic device including: displaying an image corresponding to each image file of a plurality of image files stored in a storage unit, on a screen of the electronic device; selecting a specific object included in the image displayed on the screen; and converting the displayed image to another image stored in the storage unit according to an input by input means or setting of an automatic screen conversion function, and displaying the converted image, wherein the displaying of the converted image includes preventing images including the selected object among images of the plurality of image files stored in the storage unit from being displayed on the display unit.
- the method may further include, after the specific object is selected, displaying, on a screen, function selecting means for executing a function for preventing the images including the selected object from being displayed on the display unit.
- the function selecting means may be in the form of a menu window including a function selection menu for at least one function related to processing of an image displayed on the display unit.
- the specific object included in the image displayed on the screen may be selected when a specific area in the image is selected by input means to select at least one object included in the selected area.
- the specific object included in the image displayed on the screen may be selected when one or more objects included in the image displayed on the screen are detected, areas of the detected objects are displayed on the image, and an area is selected from among the displayed areas of the detected objects.
- the selected object may be a human's face.
- the recording medium may include all kinds of recording media capable of storing programs and data that is readable by computer system. Examples of the recording medium are Read Only Memory (ROM), Random Access Memory (RAM), Compact Disk (CD), Digital Video Disk (DVD)-ROM, magnetic tape, floppy disk, an optical data storage device, and an embedded multimedia card (eMMC). Also, the recording medium may be implemented in the form of carrier waves (for example, transmission through the Internet). Also, the recording medium may be distributed in computer system connected through a network so that computer-readable codes can be stored and executed in a distributed manner.
- ROM Read Only Memory
- RAM Random Access Memory
- CD Compact Disk
- DVD Digital Video Disk
- the recording medium may be implemented in the form of carrier waves (for example, transmission through the Internet).
- the recording medium may be distributed in computer system connected through a network so that computer-readable codes can be stored and executed in a distributed manner.
- a user can view images including a person or object that he/she wants to view among stored images through an electronic device such as a smart phone including screen display means, which leads to convenience in viewing images such as pictures through the electronic device.
- a user can exclude images including a person or object that he/she does not want to view from stored images to view images that he/she wants to view through an electronic device such as a smart phone including screen display means, which also leads to convenience in viewing images such as pictures through the electronic device.
- FIG. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure
- FIG. 2 is a front perspective view of an electronic device according to an embodiment of the present disclosure
- FIG. 3 is a rear perspective view of an electronic device according to an embodiment of the present disclosure.
- FIGS. 4 and 5 are views for describing a general method of viewing images in an electronic device
- FIG. 6 is a view for describing a concept of displaying an image by recognizing an object displayed on a screen of an electronic device according to an embodiment of the present disclosure
- FIG. 7 is a block diagram illustrating a detailed configuration of an apparatus of displaying an image by recognizing an object displayed on a screen of an electronic device according to an embodiment of the present disclosure
- FIG. 8A is a flowchart illustrating a procedure of displaying an image by recognizing an object displayed on a screen of an electronic device according to an embodiment of the present disclosure
- FIG. 8B is a flowchart illustrating a procedure of displaying an image by recognizing an object displayed on a screen of an electronic device according to another embodiment of the present disclosure
- FIG. 9 is a flowchart illustrating a procedure of viewing an image by selecting an object from a screen of an electronic device according to an embodiment of the present disclosure
- FIG. 10 is a flowchart illustrating a procedure of viewing an image by selecting an object from a screen of an electronic device according to another embodiment of the present disclosure
- FIG. 11 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device
- FIG. 12 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device
- FIG. 13 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device
- FIG. 14 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device
- FIG. 15 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device
- FIG. 16 shows an example in which embodiments of the present disclosure are implemented on screens of an electronic device.
- FIG. 17 is a block diagram illustrating a detailed configuration of a device implemented according to an embodiment of the present disclosure.
- ordinal numbers such as “first”, “second”, and so forth, will be used to describe various components, those components are not limited by the terms. The terms are used only for distinguishing one component from another component. For example, a first component may be referred to as a second component and similarly, a second component may also be referred to as a first component, without departing from the teaching of the inventive concept.
- the term “and/or” used herein includes any and all combinations of one or more of the associated listed items.
- Embodiments of the present disclosure disclose an apparatus and method for recognizing an object included in a specific image displayed on a screen among a plurality of images stored in an electronic device, and displaying one or more images relating to the recognized object on a screen.
- the object included in the specific image may be selected by a user through input means.
- a method of selecting and recognizing the object for example, there is a method of enabling a user to select a specific area of an image displayed on a screen using input means, and performing image processing on the selected area to thereby select and recognize a specific object included in the selected area.
- filtering for displaying only images including the selected object or filtering for excluding images including the selected object to display the other images may be performed.
- objects that can be selected from the image may include any object that can be identified from the entire image, such as a human's face, a human body, a part of a human body, an object that a person possesses, an object that a person wears, an animal, a building, a part of a building, a tree, an object fixed on the background, a movable object, etc.
- the following description relates to an example of detecting at least one object included in an image
- various embodiments of the present disclosure can be also applied to an example of detecting an object included in any one image among a plurality of images configuring a video file.
- the embodiments of the present disclosure can be applied to moving images as well as still images.
- the apparatus and method for displaying an image by recognizing an object displayed on a screen of an electronic device may be implemented by any electronic device including display means (for example, a touch screen).
- the electronic device according to an embodiment of the present disclosure may include any electronic device in which a predetermined application capable of displaying an image through the display means and controlling an image display method can be installed.
- the electronic device may be an arbitrary device including display means, and may be a digital camera, a smart phone, a mobile phone, a game, television (TV), a display apparatus, a vehicle-mounted head unit, a notebook computer, a laptop computer, a tablet computer, Personal Media Player (PMP), Personal Digital Assistants (PDA), a navigation system, a bank's Automated Teller Machine (ATM), a store's Point-Of-Sale (POS) system, or the like.
- the electronic device may be a flexible device or a flexible display device.
- a representative one of the electronic devices is a mobile device (for example, a mobile phone or a smart phone), and some of components included in the mobile device may be omitted or modified as necessary.
- a configuration of a mobile device which is an example of an electronic device to which the present disclosure can be applied, will be described with reference to FIGS. 1 to 3 , below.
- FIG. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure.
- an electronic device 100 may connect to an external electronic device (not shown) using at least one of a communication module 120 , a connector 165 , and an earphone connecting jack 167 .
- the external electronic device may include an earphone, an external speaker, a Universal Serial Bus (USB) memory, a battery charger, a Cradle/Dock, a Digital Multimedia Broadcasting (DMB) antenna, a mobile payment system, healthcare equipment (a blood glucose meter, etc.), a game, a vehicle navigation system, and the like, which can be removably connected to the electronic device 100 through a line.
- USB Universal Serial Bus
- DMB Digital Multimedia Broadcasting
- the electronic device 100 may include a Bluetooth communication apparatus, a Near Field Communication (NFC) apparatus, a WiFi Direct communication apparatus, a Wireless Access Point (WAP), and the like, which can be connected to the external electronic device in a wireless fashion. Also, the electronic device 100 may be connected to one of other electronic devices (for example, a mobile phone, a smart phone, a tablet PC, a desktop PC, and a server) in a wired/wireless fashion.
- NFC Near Field Communication
- WiFi Direct communication apparatus Wireless Access Point
- WAP Wireless Access Point
- the electronic device 100 may include at least one touch screen 190 and at least one touch screen controller 195 .
- the electronic device 100 may include a controller 110 , a communication module 120 , a multimedia module 140 , a camera module 150 , an input/output module 160 , a sensor module 170 , a storage unit 175 , and a power supply unit 180 .
- the communication module 120 may include a mobile communication module 121 , a sub communication module 130 , and a broadcasting communication module 141 .
- the sub communication module 130 may include at least one of a Wireless LAN (WLAN) module 131 and a short-range communication module 132
- the multimedia module 140 may include at least one of an audio play module 142 and a video play module 143
- the camera module 150 may include at least one of a first camera 151 and a second camera 152
- the input/output module 160 may include at least one among a button 161 , a microphone 162 , a speaker 163 , a vibration device 164 , the connector 165 , and a keypad 166 .
- the controller 110 may include a CPU 111 , a Read Only Memory (ROM) 112 that stores control programs for controlling the electronic device 100 , and a Random Access Memory (RAM) 113 that stores signals or data received from the outside or is used as a memory area for tasks being performed by the electronic device 100 .
- the CPU 111 may include a single core, a dual core, a triple core, or a quad core.
- the CPU 111 , ROM 112 , and RAM 113 may be connected to each other through internal buses.
- the controller 110 may control the communication module 120 , the multimedia module 140 , the camera module 150 , the input/output module 160 , the sensor module 170 , the storage unit 175 , the power supply unit 180 , the touch screen 190 , and the touch screen controller 195 .
- the controller 110 may perform control operation of searching for one or more images including at least one object selected from an image displayed on the touch screen 190 to filter the found images so that a user can view the found images or to exclude the found images so that the user can view the other images. Details about the functions of the controller 110 according to embodiments of the present disclosure will be described with reference to FIG. 7 , later.
- an input value may be input through a user input of touching the touch screen 190 , a gesture input of inputting a gesture through the camera module 150 , a switch/button input of pressing the buttons 161 or the keypad 166 , and a voice input of inputting voice through the microphone 162 .
- the controller 110 may sense a user input event such as a hovering event which is an indirect touch input of making an input unit 168 approach the touch screen 190 or of locating the input unit 168 close to the touch screen 190 . If an object included in an image is selected by one of various kinds of input means, and one of various filtering function commands is input, according to an embodiment of the present disclosure, the controller 110 may control an image viewing function according to the function command.
- a user input event such as a hovering event which is an indirect touch input of making an input unit 168 approach the touch screen 190 or of locating the input unit 168 close to the touch screen 190 .
- the controller 110 may detect various user inputs received through the touch screen 190 , the camera module 150 , the input/output module 160 , and the sensor module 170 .
- the user inputs may include various kinds of information that is input to the electronic device 100 , such as a user's gesture, voice, movement of pupil, iris recognition, bio signals, and the like.
- the controller 110 may control the electronic device 100 to perform a predetermined operation or function corresponding to the detected user input.
- the controller 110 may output a control signal to the input unit 168 or the vibration device 164 .
- the control signal may include information about a vibration pattern, and the input unit 168 or the vibration device 164 may generate vibration according to the vibration pattern.
- the information about the vibration pattern may represent the vibration pattern itself or an identifier of the vibration pattern.
- the control signal may include a request for generating vibration.
- the electronic device 100 may include at least one of the mobile communication module 121 , the WLAN module 131 , and the short-range communication module 132 according to performance.
- the mobile communication module 121 may enable the electronic device 100 to connect to an external device through mobile communication using at least one or a plurality of antennas (not shown), under the control of the controller 110 .
- the mobile communication module 121 may transmit/receive radio signals for a voice call, a video call, a SMS message, or a MIMS message to/from a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown), or another electronic device (not shown) when the corresponding phone number is input to the electronic device 100 .
- the sub communication module 130 may include at least one of the WLAN module 131 and the short-range communication module 132 as described above.
- the sub communication module 130 may include one of the WLAN module 131 and the short-range communication module 132 , or both the WLAN module 131 and the short-range communication module 132 .
- the WLAN module 131 may be connected to the Internet at a place in which a WAP has been installed, under the control of the controller 110 .
- the WLAN module 131 may support the IEEE802.11x standard.
- the short-range communication module 132 may perform short-range communication between the electronic device 100 and an external electronic device in a wireless fashion under the control of the controller 110 .
- the short-range communication may include Bluetooth, Infrared Data Association (IrDA), WiFi-Direct communication, NFC, and the like.
- the broadcasting communication module 141 may receive broadcasting signals (for example, TV broadcasting signals, radio broadcasting signals, or data broadcasting signals) and broadcasting additional information (for example, an Electric Program Guide (EPS) or an Electric Service Guide (ESG)) transmitted from a broadcast station through a broadcasting communication antenna (not shown), under the control of the controller 110 .
- broadcasting signals for example, TV broadcasting signals, radio broadcasting signals, or data broadcasting signals
- additional information for example, an Electric Program Guide (EPS) or an Electric Service Guide (ESG) transmitted from a broadcast station through a broadcasting communication antenna (not shown), under the control of the controller 110 .
- EPS Electric Program Guide
- ESG Electric Service Guide
- the multimedia module 140 may include the audio play module 142 and the video play module 143 as described above.
- the audio play module 142 may reproduce a digital audio file (for example, a file with the extension “.mp3”, “.wma”, “.ogg” or “.wav”) that is stored in the storage unit 175 or received, under the control of the controller 110 .
- the video play module 143 may reproduce a digital video file (for example, a file with the extension “.mpeg”, “.mpg”, “.mp4”, “.avi”, “.mov”, or “.mkv”) that is stored or received, under the control of the controller 110 .
- the multimedia module 140 may be integrated into the controller 110 .
- the camera module 150 may include at least one of the first and second cameras 151 and 152 for photographing still images or moving images under the control of the controller 110 . Also, the camera module 150 may include at least one among the body tube 155 for zooming in/out to photograph a subject, the motor unit 154 for controlling the movement of the body tube 155 for zooming-in/out of the body tube 155 , and the flash 153 for providing a secondary light source required for photographing the subject.
- the first camera 151 may be disposed in the front side of the electronic device 100
- the second camera 152 may be disposed in the rear side of the electronic device 100 .
- the input/output module 160 may include at least one among at least one button 161 , at least one microphone 162 , at least one speaker 163 , at least one vibration device 164 , the connector 165 , the keypad 166 , the earphone connecting jack 167 , and the input unit 168 .
- the input/output module 160 is not limited to the above-mentioned devices, and a cursor control, such as a mouse, a trackball, a joystick, or cursor direction keys, may be provided to control the movement of a cursor on the touch screen 190 .
- the button 161 may be formed on the front, side, or rear surface of the housing (or case) of the electronic device 100 , and may include at least one among a power/lock button, a volume button, a menu button, a home button, a back button, and a search button.
- the microphone 162 may receive a voice or sound under the control of the controller 110 to generate an electrical signal.
- the speaker 163 may output sound corresponding to various signals or data (for example, radio data, broadcasting data, digital audio data, digital video data, etc.) to the outside of the electronic device 100 , under the control of the controller 110 .
- the speaker 163 may output sound (for example, button manipulation sound corresponding to a call, currency connection sound, the other party's voice, etc.) corresponding to a function that is performed by the electronic device 100 . There may be provided one or more speakers 163 at one or more appropriate locations on the housing of the electronic device 100 .
- the vibration device 164 may convert an electrical signal into mechanical vibration under the control of the controller 110 . For example, if a voice or video call is made by another device (not shown) when the electronic device 100 is in a vibration mode, the vibration device 164 may operate. There may be provided one or more vibration devices 164 in the housing of the electronic device 100 . The vibration device 164 may operate in correspondence to a user input through the touch screen 190 .
- the connector 165 may be used as an interface for connecting the electronic device 100 to an external electronic device or a power source (not shown).
- the controller 110 may transmit data stored in the storage unit 175 of the electronic device 100 to an external electronic device or receive data from the external electronic device through a wired cable connected to the connector 165 .
- the electronic device 100 may receive power from a power source or charge its battery using the power source through the wired cable connected to the connector 165 .
- the keypad 166 may receive a key input from a user to control the electronic device 100 .
- the keypad 166 includes a physical keypad (not shown) formed on the electronic device 100 or a virtual keypad (not shown) displayed on the touch screen 190 .
- the physical keypad formed on the electronic device 100 may be excluded according to the performance or structure of the electronic device 100 .
- the earphone (not shown) may be inserted into the earphone connecting jack 167 to connect to the electronic device 100 .
- the input unit 168 may be inserted into and held in the electronic device 100 , and when it is used, the input unit 168 may be drawn or separated from the electronic device 100 .
- a detachment/attachment recognition switch 169 that operates in correspondence to attachment and detachment of the input unit 168 is provided.
- the detachment/attachment recognition switch 169 may output a signal corresponding to attachment/separation of the input unit 168 to the controller 110 .
- the detachment/attachment recognition switch 169 may be configured to directly or indirectly contact the input unit 168 when the input unit 169 is attached in the electronic device 100 .
- the detachment/attachment recognition switch 169 may generate a signal (that is, a signal for notifying attachment or separation of the input unit 168 ) corresponding to attachment or separation of the input unit 168 based on whether the detachment/attachment recognition switch 169 contacts the input unit 168 , and outputs the signal to the controller 110 .
- the sensor module 170 may include at least one sensor for detecting the state of the electronic device 100 .
- the sensor module 170 may include at least one sensor among a proximity sensor (not shown) for detecting an approach to the electronic device 100 , an ambient light sensor (not shown) for detecting the ambient light intensity around the electronic device 100 , a motion sensor (not shown) for detecting a motion (for example, rotation, acceleration, vibration) of the electronic device 100 , a geo-magnetic sensor (not shown) for detecting a point of the compass of the electronic device 100 using the earth's magnetic field, a gravity sensor (not shown) for detecting a direction in which gravity is applied, an altimeter (not shown) for measuring atmospheric pressure to detect an altitude, and a GPS module 157 .
- a proximity sensor for detecting an approach to the electronic device 100
- an ambient light sensor for detecting the ambient light intensity around the electronic device 100
- a motion sensor for detecting a motion (for example, rotation, acceleration, vibration) of the electronic device 100
- the GPS module 157 can receive radio waves from a plurality of GPS satellites (not shown) on the orbit around the earth, and calculate the location of the electronic device 100 based on a time of arrival of the radio waves from the GPS satellites to the electronic device 100 .
- the storage unit 175 may store signals or data that is input/output according to the operation of the communication module 120 , the multimedia module 140 , the camera module 150 , the input/output module 160 , the sensor module 170 , or the touch screen 190 , under the control of the controller 110 .
- the storage unit 175 may store applications and control programs for controlling the electronic device 100 or the controller 110 .
- the term “storage unit” indicates an arbitrary data storage device, such as the storage unit 175 , the ROM 112 and RAM 113 in the controller 110 , a memory card (for example, a SD card or a memory stick) installed in the mobile terminal 1100 , and the like.
- the storage unit 175 may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), and a solid state drive (SSD).
- the storage unit 175 may store applications with various functions, such as navigation, a video call, a game, a time-based alarm application, etc., images for providing a user with Graphic User Interfaces (GUIs) associated with the applications, user information, document, databases or data related to a method of processing touch inputs, background images (a menu screen, a lock screen, etc.) or operation programs required to drive the electronic device 100 , images photographed by the camera module 150 , etc.
- GUIs Graphic User Interfaces
- the storage unit 175 may store a viewer application for viewing an image, according to an embodiment of the present disclosure, and store one or more images in various formats.
- a plurality of images stored in the storage unit 175 may be divided in units of predetermined groups, folders, categories, etc. As shown in FIG. 6 , according to an embodiment of the present disclosure, an image including a selected object or identification information of the corresponding image may be stored in a separate storage area (for example, a temporary storage unit).
- the storage unit 175 is machine (for example, a computer)-readable media, and the term “machine-readable media” can be defined as media of providing data to a machine so that the machine can perform a specific function.
- the storage unit 175 may include non-volatile media and volatile media.
- the media should be a tangible device so that commands transferred by the media can be detected by a physical device for reading the commands through a machine.
- the machine-readable media may include at least one among a floppy disk, a flexible disk, a hard disk, a magnetic tape, a compact disc read-only memory (CD-ROM), an optical disk, a punch card, a paper tape, a RAM, a Programmable Read-Only Memory (PROM), an Erasable PROM (EPROM), and a FLASH-EPROM, however, the machine-readable media is not limited to the above-mentioned devices.
- the power supply unit 180 may supply power to one or more batteries installed in the housing of the electronic device 100 under the control of the controller 110 .
- the one or more batteries may supply power to the electronic device 100 .
- the power supply unit 180 may supply power received from an external power source to the electronic device 100 through a wired cable connected to the connector 165 .
- the power supply unit 180 may supply power received wirelessly from an external power source to the electronic device 100 through wireless charging technology.
- the electronic device 100 may include at least one touch screen 190 that provides a user with GUIs corresponding to various services (for example, a call, data transmission, and photographing).
- the touch screen 190 may output an analog signal corresponding to at least one user input inputted to a GUI to the touch screen controller 195 .
- the touch screen 190 may receive at least one user input through a user's body part (for example, a finger including a thumb) or the input unit 168 (for example, a stylus pen or an electronic pen).
- the touch screen 190 may be a resistive touch screen, a capacitive touch screen, an infrared touch screen, an acoustic wave touch screen, or their combination.
- the touch screen 190 may include at least two touch panels capable of respectively sensing touch/approach inputs by a finger and the input unit 168 in order to respectively receive inputs by the finger and the input unit 168 .
- the at least two touch panels may provide different output values to the touch screen controller 195 .
- the touch screen controller 195 may recognize values sensed through the at least two touch screen panels through as different values to determine whether an input through the touch screen 190 is an input by a finger or an input by the input unit 168 .
- the “touch” is not limited to a contact of a user's body or touchable input means to the touch screen 190 , and may include non-contact recognition (for example, when a user's body or the touchable input means is located within a recognition distance (for example, 1 mm) from the touch screen 190 ).
- the recognition distance in which the touch screen 190 can recognize the user input may depend on the performance or structure of the electronic device 100 .
- the touch screen controller 195 may convert an analog signal received from the touch screen 190 into a digital signal, and transfers the digital signal to the controller 110 .
- the controller 110 may control the touch screen 190 using the digital signal received from the touch screen controller 195 .
- the touch screen controller 195 may detect a value (for example, a current value) output through the touch screen 190 to determine an hovering interval or distance as well as a user's input location, convert the determined distance value into a digital signal (for example, a z coordinate), and then provide the digital signal to the controller 110 .
- the touch screen controller 195 may detect a value (for example, a current value) output through the touch screen 190 to estimate pressure with which a user input device presses the touch screen 190 , convert the estimated pressure value into a digital signal, and then provide the digital signal to the controller 110 .
- a value for example, a current value
- FIG. 2 is a front perspective view of an electronic device according to an embodiment of the present disclosure
- FIG. 3 is a rear perspective view of an electronic device according to an embodiment of the present disclosure.
- the touch screen 190 may be placed in the center of the front side 101 of the electronic device 100 .
- the touch screen 190 may be formed with a large area occupying the main part of the front side 101 of the electronic device 100 .
- FIG. 2 shows an example in which a main home screen is displayed on the touch screen 190 .
- the main home screen is a screen initially appearing on the touch screen 190 when the electronic device 100 is powered on. If the electronic device 100 has different home screens of several pages, the main home screen may be the first home screen among the home screens of the pages.
- the home screen may display shortcut icons 191 - a , 191 - b , and 191 - c for executing frequently used applications, a main menu conversion key 191 - d , a current time, weather information, etc. If a user selects the main menu conversion key 191 - d , a menu screen may be displayed on the touch screen 190 . Also, a status bar 192 representing the status of the electronic device 100 , such as a battery charged state, reception signal intensity, a current time, etc., may be displayed on the upper part of the touch screen 190 .
- a home button 161 a may be displayed on the lower part of the touch screen 190 .
- a menu button 161 b may be displayed on the lower part of the touch screen 190 .
- a back button 161 c may be displayed on the lower part of the touch screen 190 .
- the home button 161 a may be used to display a main home screen on the touch screen 190 .
- a main home screen may be displayed on the touch screen 190 .
- the home button 161 a is selected while applications are executed on the touch screen 190 , the main home screen as shown in FIG. 2 may be displayed on the touch screen 190 .
- the home button 161 a may be used to display recently used applications on the touch screen 190 or to display a task manager on the touch screen 190 .
- the menu button 161 b may provide a link menu that can be displayed on the touch screen 190 .
- the link menu may include a widget adding menu, a lock screen changing menu, a search menu, an edit menu, a setting menu, etc.
- the back button 161 c may be used to display a screen executed just before a screen being currently executed or to terminate a most recently used application.
- the first camera 151 , an ambient light sensor 171 , and a proximity sensor 172 may be disposed in one edge part of the front side of the electronic device 100 .
- the second camera 152 , the flash 153 , and the speaker 163 may be disposed in the back side 103 of the electronic device 100 .
- a power/lock button 161 d On the lateral sides of the mobile terminal 102 , for example, a power/lock button 161 d , volume buttons 161 e including a volume-up button 161 f and a volume-down button 161 g , a terrestrial DMB antenna for receiving broadcasts, one or more microphones 162 , etc. may be disposed.
- the DMB antenna may be fixed or removably attached on the electronic device 100 .
- the connector 165 may be formed in the lateral side of the lower end of the mobile terminal 10 .
- the connector 165 may include a plurality of electrodes, and can be connected to an external device through a line.
- the earphone connecting jack 167 may be formed in the lateral side of the upper end of the electronic device 100 . An earphone may be inserted into the earphone connecting jack 167 .
- the input unit 168 may be installed in the lateral side of the lower end of the electronic device 100 .
- the input unit 168 may be inserted into the inside of the electronic device 100 and stored in the electronic device 100 , and when it is used, the input unit 168 may be drawn and separated from the electronic device 100 .
- FIG. 6 is a view for describing a concept of displaying an image by recognizing an object displayed on a screen of an electronic device according to an embodiment of the present disclosure.
- a plurality of pictures or images stored in an image storage unit may be sequentially displayed on a screen in a predetermined order (for example, in the order of dates on which the pictures or images were photographed, in order of names of the pictures or images, or in the order of dates on which the pictures or images were stored).
- the images may be images stored in a storage unit of the electronic device.
- the images may be images stored in a server or located on a network, or images stored in another electronic device.
- images stored in the electronic device may be shown on the screen, or according to another embodiment of the present disclosure, images stored in another electronic device may be selectively shown on the screen.
- a specific image may be selected from among images stored in a cloud server, and the selected image may be received through the network to be shown on the screen.
- the object may be identified, and one or more images including the identified object may be searched in all images stored in the corresponding folder (or category) or in all stored images.
- the found images including the object may be stored in a separate temporary storage unit. Accordingly, when a user wants to selectively view the images including the specific object, the user can view the images stored in the temporary storage unit. Also, according to another embodiment of the present disclosure, the remaining images not including the selected object may be stored in a separate temporary storage unit in order to enable a user to selectively view the images not including the specific object.
- information stored in the temporary storage unit may be deleted when a filtering function according to an embodiment of the present disclosure is cancelled or released.
- FIG. 6 is a view for describing the technical concept of a filtering method according to various embodiments of the present disclosure.
- one or more objects included in an image may have one or more identification information (for example, tag information).
- one or more images including an identified object may be searched in all images stored in the corresponding storage folder (or category) or in all stored images, based on the identification information. Accordingly, when a user performs operation for viewing pictures or images, images including the object having the identification information or images not including the object having the identification information may be displayed.
- FIG. 6 an example of selecting images including an identified object and storing the selected images in a temporary storage unit is shown.
- the corresponding image files may be all stored in the temporary storage unit, or information (for example, address information on memory) about the image files may be stored in the temporary storage unit so that a user can view the selected images from the image storage unit by referring to the information about the image files stored in the temporary storage unit.
- FIG. 7 is a block diagram illustrating an electronic device according to various embodiments of the present disclosure.
- an electronic device 700 (for example, the electronic device 100 ) according to an embodiment of the present disclosure may include a mode switching unit 710 , an object identifying unit 720 , a function selecting unit 730 , an object selecting unit 740 , an image searching unit 750 , and a search result processor 760 .
- the entire or a part of the components of the electronic device 700 may be included in the controller 110 of the electronic device 100 of FIG. 1 .
- the mode switching unit 710 may perform, if mode selection information is input when an image is displayed on a screen, a function of switching a current mode to a mode (for example, an object selection mode) for selecting an object.
- a mode for example, an object selection mode
- a user can select an object using one of various kinds of input means. Accordingly, a part of the image displayed on the screen may be selected as an area or a point, or a specific object may be selected from among one or more objects detected from the image.
- the object identifying unit 720 may perform a function of identifying at least one object included in the image displayed on the current screen. For example, if a current mode is switched to the object selection mode by the mode conversion unit 710 , at least one object included in the image displayed on the current screen may be identified.
- the object may be identified by image processing. For example, the object may be identified by a method of extracting outlines, a method of extracting features of an image, or a method of using contrast with respect to the background. If one or more objects are identified by the object identifying unit 720 , areas of the corresponding identified objects may be displayed on the screen according to the results of the identification, as shown in FIG. 11 .
- the objects may be identified by searching for images based on identification information (for example, tag information) of the objects.
- the object selecting unit 740 may perform a function of selecting a specific object from among the objects identified by the object identifying unit 720 according to object selection information input by a user.
- a specific object may be selected from among the three objects by a user.
- the mode switching unit 710 it is possible to enable a user to select an area of an object in the object selection mode according to mode switching by the mode switching unit 710 , as shown in FIG. 14 .
- a user may select a specific area of an image displayed on a screen using one of various kinds of input means (for example, a touch pen, a stylus pen, or a touch input using a finger).
- the object selecting unit 740 may select the selected area as an object.
- the object selecting unit 740 may perform a function of selecting a specific object from an image displayed on a screen, based on object selection information input through input means. For example, as shown in FIG. 14 , the object selecting unit 740 may select an area including at least one part of an image displayed on a screen to select the selected area as an object. As another example, as shown in FIG. 11 , the object selecting unit 740 may identify one or more objects included in an image currently displayed on a screen, display the identified objects on the screen, and then cause a user to select a specific object from among the displayed objects.
- the function selecting unit 730 may perform a function of selecting at least one function related to the selected object.
- the function related to the selected object may include a function (hereinafter, referred to as a “Face on” function) of filtering images to display images including the selected object, and a function (hereinafter, referred to as a “Exclude” function) of filtering images in such a way to exclude images including the selected object to display images not including the selected object, according to an embodiment of the present disclosure.
- a menu window for selecting the functions may be displayed in the screen so that the user can select a desired function from the menu window.
- the image searching unit 750 may perform a function of searching for one or more images including an object selected by the object selecting unit 740 in images (for example, images stored in a specific folder (or category) selected by a user, or all images stored in the electronic device or a server) that are to be searched. According to an embodiment, by examining similarities between the selected object and the images that are to be searched, it may be determined whether the corresponding object is included in the images.
- the search result processor 760 may display the images including the selected object on the display unit 770 , according to the function selected by the function selecting unit 730 . Also, for example, the search result processor 760 may display at least one image not including the selected object on the display unit 770 .
- a predetermined function for example, a function of displaying images including a selected object or a function of displaying images not including a selected object
- the components of the electronic device 700 shown as separate units in FIG. 7 , represent that they can be functionally and logically distinct parts. That is, this does not mean that they are physically separate components or implemented as separate codes.
- each functional unit may signify a functional and structural combination of hardware for implementing the technological concept of the present disclosure and software for driving the hardware.
- the functional unit may signify a logical unit of a predetermined code and a hardware resource for implementing the predetermined code, and it does not necessarily mean physically connected codes or one kind of hardware.
- FIG. 8A is a flowchart illustrating a procedure of displaying an image by recognizing an object displayed on a screen of an electronic device according to various embodiments of the present disclosure.
- a predetermined area for example, an area including a distinguishable object
- an image for example, a picture
- an object included in the selected area may be identified, in operation S 802 .
- one or more images including the identified object may be searched in images stored in the corresponding folder (or category) or in all or a part of images stored in the storage unit, in operation S 803 .
- the found images including the identified object may be displayed on a screen, in operation S 804 .
- FIG. 8B is a flowchart illustrating a procedure of displaying an image by recognizing an object displayed on a screen of an electronic device according to another embodiment of the present disclosure.
- a predetermined area for example, an area including a distinguishable object
- an image for example, a picture
- an object included in the selected area may be identified, in operation S 806 .
- one or more images including the identified object may be searched in images stored in the corresponding folder (or category) or in all or a part of images stored in the storage unit, in operation S 807 .
- the found images including the identified object may be excluded, and the remaining images may be displayed on a screen.
- FIG. 9 is a flowchart illustrating a procedure of viewing an image by selecting an object from a screen of an electronic device according to an embodiment of the present disclosure. For example, if an application for performing an image display function is executed, at least one image (for example, at least one picture) may be displayed through a screen. If a user viewing the image presses a predetermined button or selects a mode switching function provided through a menu, the electronic device may enter an object selection mode, in operation S 901 .
- the application may identify one or more objects included in the currently displayed image, in operation S 902 . Then, the application may display areas of the identified objects on a screen, as shown in FIG. 11 , in operation S 903 . The user may select the area of a specific object from among the areas of the one or more objects displayed on the screen, in operation S 904 . Also, as shown in FIG. 12 or 15 , the user may select a filtering function, in operation S 905 . According to another embodiment, the user may select an object from an image having no marks indicating objects.
- one or more images including the objects in the selected areas may be searched in images stored in a folder (or category) in which the current image is located or in all or a part of images stored in a storage unit, in operation S 906 .
- the images may be images stored in a server or another electronic device.
- the selected filtering function is a filtering function for including the selected objects (“Yes” in operation S 907 )
- images including the identified objects may be filtered and displayed as the results of the searching, in operation S 908 .
- the filtered images may be sequentially displayed on a screen according to the user's screen manipulation.
- the selected filtering function is a filtering function for excluding the selected objects (“No” in operation S 907 )
- images including the identified objects may be excluded and the remaining images may be filtered and displayed as the results of the searching, in operation S 909 .
- the filtered images may be sequentially displayed on a screen according to the user's screen manipulation.
- FIG. 10 is a flowchart illustrating a procedure of viewing an image by selecting an object from a screen of an electronic device according to another embodiment of the present disclosure. For example, if an application for displaying images is executed, at least one image (for example, at least one picture) may be displayed through a screen. If a user viewing the image presses a predetermined button or selects a mode switching function provided through a menu, the electronic device may enter an object selection mode, in operation S 1001 .
- a user may select a specific area on a screen using input means, in operation S 1002 .
- the selected area may be in the shape of a closed loop, as shown in FIG. 14 .
- the user may select a filtering function, as shown in FIG. 12 or 15 , in operation S 1003 .
- an object may be identified in the selected area, in operation S 1004 .
- one or more images including the identified object may be searched in images stored in a folder (or, category) in which the current image is located or in all or a part of images stored in the storage unit, in operation S 1005 .
- the images may be images stored in a server or another electronic device.
- the selected filtering function is a filtering function for including the selected object (“Yes” in operation S 1006 )
- one or more images including the identified object may be filtered and displayed as the results of the searching, in operation S 1007 .
- the filtered images may be sequentially displayed on a screen according to a user's screen manipulation.
- the selected filtering function is a filtering function for excluding the selected object (“No” in operation S 1006 )
- one or more images including the identified object may be excluded and the remaining images may be displayed as the results of the searching, in operation S 1008 .
- the filtered images may be sequentially displayed on a screen according to a user's screen manipulation.
- the method of displaying an image by recognizing an object displayed on a screen of the electronic device and the method of viewing an image by selecting an object from a screen of the electronic device may be implemented as computer-executable programs executable by various computational devices and stored in computer-readable recording medium.
- the computer readable recording medium may include a program command, a data file, a data structure, or a combination thereof.
- the program command written to the computer readable recording medium may be specially designed and configured or may be already known to those skilled in the field of computer software.
- Examples of the computer readable recording medium include magnetic storage media (e.g., hard disks, floppy disks, and magnetic tapes), optical recording media (e.g., CD-ROMs and DVDs), magneto-optical storage media (e.g., floptical disks), and hardware devices (e.g., Read-Only Memories (ROMs), Random-Access Memories (RAMs), and flash memories) configured to store and execute program commands.
- Program commands may include, for example, a high-level language code that can be executed by a computer using an interpreter, as well as a machine language code made by a complier.
- the hardware devices may be configured to be operated by one or more software modules to implement the present disclosure, and vice versa.
- FIG. 11 if an image is displayed on a screen of an electronic device, and the electronic device enters a mode (for example, an object selection mode) for selecting an object, one or more objects included in the image may be identified so that object areas can be displayed on the screen.
- FIG. 11 shows an example in which human faces are identified as objects by image processing, and object areas 1110 a , 1110 b , and 1110 c are represented by dotted lines. However, the object areas 1110 a , 1110 b , and 1110 c may be represented in various manners, instead of dotted lines.
- the object areas 1110 a , 1110 b , and 1110 c may be displayed with solid lines of different colors or with lines drawn around the outlines (for example, contours) of the corresponding objects. Also, by performing image processing on the entire identified objects, the object areas 1110 a , 1110 b , and 1110 c may have diverse effects.
- the user may select an object from among the displayed objects through various input means (for example, a touch input by a finger).
- the user may select at least one object from an image having no marks indicating objects.
- a plurality of objects may be selected. If the plurality of objects are selected, filtering for displaying one or more images including at least one object of the plurality of objects, or filtering for not displaying one or more images including at least one object of the plurality of objects may be performed.
- a menu window 1200 for enabling a user to select various additional functions related to the selected objects may be displayed on a screen, as shown in FIG. 12 .
- a user can transmit a message or E-mail including the current image or the selected objects, or can upload the corresponding image on a Social Network Service (SNS) site.
- SNS Social Network Service
- a filtering button for example, a Face on button 1210 for including objects is selected from the menu window 1200 , one or more images including the selected objects as shown in FIG. 11 among images in the current folder (or category), all stored images, or images stored in a server or another electronic device may be successively displayed on the screen.
- the filtering button 1210 for including objects when a user selects the filtering button 1210 for including objects, as shown in FIG. 12 , and slides/drags ( 1320 ) his/her finger on a currently displayed screen image 1310 to view the next image, the next image that is to be displayed following the screen image 1310 may be, if the next image does not include the selected objects, skipped so as to be not displayed, and other images including the selected objects may be displayed.
- first to fourth images 1311 to 1314 are sequentially displayed before a function according to an embodiment of the present disclosure is executed
- a filtering function for including objects may be executed.
- images not including the selected objects among the first to fourth images 1311 to 1314 may be excluded, and the remaining images may be displayed.
- a user may slide/drag his/her finger on the first image 1311 to view the next image.
- the second and third images 1312 and 1313 may be skipped, and the fourth image 1314 may be displayed on the screen.
- the user can selectively view his/her desired images.
- a filtering button 1510 for example, an “Exclude” button for excluding objects from a menu window 1500 , as shown in FIG. 15 , images including the selected objects as shown in FIG. 11 among images in the current folder (or category) or all stored images may be skipped, and images not including the selected objects may be displayed.
- the filtering button 1510 for excluding objects when the user selects the filtering button 1510 for excluding objects, as shown in FIG. 15 , and slides/drags his/her finger on a currently displayed screen image 1610 to view the next image, the next image that is to be displayed following the screen image 1610 may be, if the next image includes the selected objects, skipped so as to be not displayed, and other images not including the selected objects may be displayed.
- first to fourth images 1611 to 1614 are sequentially displayed before a function according to an embodiment of the present disclosure is executed
- a filtering function for excluding objects may be executed.
- images including the selected objects among the first to fourth images 1611 to 1614 may be filtered out and excluded, and the remaining images may be displayed.
- a user may slide/drag his/her finger on the first image 1611 to view the next image.
- the second and third images 1612 and 1613 may be displayed, the fourth image 1614 may be skipped, and other images not including the object may be displayed on the screen.
- the user can exclude his/her undesired images when viewing images.
- an image is displayed on a screen of an electronic device, and the electronic device enters a mode (for example, an object selection mode) for selecting objects
- a user can himself or herself mark an object area in the displayed image using input means to thus select an object.
- an area selected by an electronic pen in the object selection mode may be represented as a selected object area 1410 by dotted lines.
- the selected object area 1410 may be represented in various manners, instead of dotted lines.
- the selected object area 1410 may be displayed with solid lines of different colors or with lines drawn around the outlines (for example, contours) of the corresponding object.
- the object area 1410 may have diverse effects.
- the object area 1410 may be in the shape of a closed loop, and at least one object included in the inside of the closed loop may be considered as a selected object.
- filtering for displaying images including at least one object of the plurality of objects, or filtering for not displaying images including at least one object of the plurality of objects may be performed.
- a menu window 1200 or 1500 for enabling a user to select various additional functions related to the selected object may be displayed on a screen, as shown in FIG. 12 or 15 .
- a user can transmit a message or E-mail including the current image or the selected object, or can upload the corresponding image on a SNS site, as shown in FIG. 12 .
- a filtering button for example, a Face on button 1210 for including objects is selected from the menu window 1200 , one or more images including the selected object as shown in FIG. 14 among images in the current folder (or category) or all stored images may be successively displayed on the screen.
- the filtering button 1210 for including objects is selected as shown in FIG. 12
- a user may slide/drag ( 1320 ) his/her finger on a currently displayed screen image 1310 to view the next image.
- the next image that is to be displayed following the screen image 1310 may be, if the next image does not include the selected object, skipped so as to be not displayed, and other images including the selected object may be displayed.
- first to fourth images 1311 to 1314 are sequentially displayed before a function according to an embodiment of the present disclosure is executed
- a filtering function for including objects may be executed.
- images not including the selected object among the first to fourth images 1311 to 1314 may be excluded, and the remaining images may be displayed.
- a user may slide/drag his/her finger on the first image 1311 to view the next image.
- the second and third images 1312 and 1313 may be skipped, and the fourth image 1314 may be displayed on the screen, as shown in FIG. 13 .
- the user can selectively view his/her desired images.
- a filtering button 1510 for example, an “Exclude” button for excluding objects from a menu window 1500 , as shown in FIG. 15 , images including the selected object as shown in FIG. 14 among images in the current folder (or category) or all stored images may be skipped, and images not including the selected object may be displayed.
- the next image that is to be displayed following the screen image 1610 may be, if the next image includes the selected object, skipped so as to be not displayed, and other images not including the selected object may be displayed.
- first to fourth images 1611 to 1614 are sequentially displayed before a function according to an embodiment of the present disclosure is executed, a filtering function for excluding objects, according to an embodiment of the present disclosure, may be executed.
- images including the selected object among the first to fourth images 1611 to 1614 may be filtered out and excluded, and the remaining images may be displayed.
- a user may slide/drag his/her finger on the first image 1611 to view the next image.
- the second and third images 1612 and 1613 may be displayed, the fourth image 1414 may be skipped, and other images not including the corresponding object may be displayed on the screen, as shown in FIG. 16 .
- the user can exclude his/her undesired images when viewing images.
- FIG. 17 is a block diagram illustrating a detailed configuration of an electronic device (for example, the electronic device 100 ) implemented according to an embodiment of the present disclosure.
- an application 1710 for performing functions according to an embodiment of the present disclosure may be installed in an electronic device 1700 .
- the application 1710 may basically include a function of an image viewer, or may be included in or implemented in connection to a pre-installed image viewer application.
- the electronic device 1700 may include a controller 1730 to perform the functions according to an embodiment of the present disclosure.
- the controller 1730 may include a decoder 1731 , an encoder 1732 , and utility 1733 for recognizing objects.
- a framework 1720 may be configured between the application 1710 and the controller 1730 .
- the framework 1720 may include a codec control function.
- a file system 1740 may perform a function of inputting/outputting a file (for example, an image file) stored in a storage unit, and a function of storing files filtered according to an embodiment of the present disclosure in filtering database (DB) 1750 .
- DB filtering database
- the decoder 1731 may decode the image file according to the format (for example, JPEG, GIF, PNG, BMP, TIFF, WBMP, etc.) of the image file to display an image through a display unit. Also, each image may be encoded according to the format of the corresponding image file by the encoder 1732 , and then stored in the storage unit.
- the format for example, JPEG, GIF, PNG, BMP, TIFF, WBMP, etc.
- the utility 1733 may compare the selected object to image files stored in the storage units to determine whether the corresponding object is included in any one(s) of the image files.
- FIG. 17 is shown as an example for implementing the embodiments of the present disclosure, and the present disclosure is not limited to the configuration of FIG. 17 .
- an image from which an object is recognized may be stored in separate database and managed, which is not described in the present disclosure. More specifically, by extracting each object (for example, a face) included in images stored in the storage unit, and causing a user to input additional information about the extracted object, images can be managed for each object.
- each image it is possible to extract one or more faces included in each image, to cause a user to input related information (for example, names, family relations, descriptions, etc.) about the extracted faces, to map the related information to the corresponding faces, and then to store the results of the mapping in database.
- related information for example, names, family relations, descriptions, etc.
- Information stored in the database may be used to provide various kinds of services in relation to the above-described embodiments of the present disclosure. For example, if a user executes an image viewer application to view images such as pictures, and selects a specific face included in the images, information corresponding to the selected face may be extracted from the database and displayed on a screen.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computational Linguistics (AREA)
- Library & Information Science (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
Claims (11)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2013-0082518 | 2013-07-12 | ||
KR1020130082518A KR102155133B1 (en) | 2013-07-12 | 2013-07-12 | Method and apparatus for displaying image |
PCT/KR2014/006265 WO2015005728A1 (en) | 2013-07-12 | 2014-07-11 | Image display method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160147792A1 US20160147792A1 (en) | 2016-05-26 |
US10528619B2 true US10528619B2 (en) | 2020-01-07 |
Family
ID=52280311
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/904,503 Active 2035-04-18 US10528619B2 (en) | 2013-07-12 | 2014-07-11 | Image display method and device |
Country Status (3)
Country | Link |
---|---|
US (1) | US10528619B2 (en) |
KR (1) | KR102155133B1 (en) |
WO (1) | WO2015005728A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160048318A1 (en) * | 2014-08-15 | 2016-02-18 | Microsoft Technology Licensing, Llc | Detecting selection of digital ink |
CN106407984B (en) * | 2015-07-31 | 2020-09-11 | 腾讯科技(深圳)有限公司 | Target object identification method and device |
KR102390836B1 (en) * | 2015-10-05 | 2022-04-26 | 삼성전자주식회사 | Electronic device and method for generating an image data |
KR102652362B1 (en) * | 2017-01-23 | 2024-03-29 | 삼성전자주식회사 | Electronic apparatus and controlling method thereof |
WO2019095392A1 (en) * | 2017-11-20 | 2019-05-23 | 华为技术有限公司 | Method and device for dynamically displaying icon according to background image |
CN111679731A (en) * | 2019-03-11 | 2020-09-18 | 三星电子株式会社 | Display device and control method thereof |
JP7313862B2 (en) * | 2019-03-29 | 2023-07-25 | キヤノン株式会社 | Information processing device, method, and program |
CN113282780A (en) * | 2021-04-28 | 2021-08-20 | 维沃移动通信有限公司 | Picture management method and device, electronic equipment and readable storage medium |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030184562A1 (en) * | 2002-03-29 | 2003-10-02 | Nobuyuki Matsumoto | Video object clipping method and apparatus |
US20060008145A1 (en) * | 2004-07-06 | 2006-01-12 | Fuji Photo Film Co., Ltd. | Image data processing apparatus and method, and image data processing program |
WO2009004524A1 (en) | 2007-06-29 | 2009-01-08 | Nokia Corporation | Apparatus, method and computer program product for using images in contact lists maintained in electronic devices |
KR20090003939A (en) | 2007-07-05 | 2009-01-12 | 삼성테크윈 주식회사 | Method for managing character image files of computer |
KR20090118674A (en) | 2008-05-14 | 2009-11-18 | 주식회사 비엔에스웍스 | Digital picture frame capable of offering communication service and method thereof |
US20090303338A1 (en) * | 2008-06-06 | 2009-12-10 | Texas Instruments Incorporated | Detailed display of portion of interest of areas represented by image frames of a video signal |
KR20100000936A (en) | 2008-06-26 | 2010-01-06 | 주식회사 케이티테크 | Method and mobile communication terminal for processing individual information |
KR20100001064A (en) | 2008-06-26 | 2010-01-06 | 주식회사 케이티 | Method and system for searching contents using image recognition at internet protocol televition |
US20110069823A1 (en) | 2009-09-22 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Communication device and communication method thereof |
KR20110083025A (en) | 2010-01-13 | 2011-07-20 | 삼성전자주식회사 | Apparatus and method for storing face image according to time variation |
KR20110128574A (en) | 2010-05-24 | 2011-11-30 | 주식회사 다음커뮤니케이션 | Method for recognizing human face and recognizing apparatus |
US20130044921A1 (en) | 2011-08-18 | 2013-02-21 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US20150286896A1 (en) * | 2012-05-24 | 2015-10-08 | Hitachi, Ltd. | Image Analysis Device, Image Analysis System, and Image Analysis Method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0347769A1 (en) * | 1988-06-20 | 1989-12-27 | The B.F. Goodrich Company | Modification of vinyl dispersion resins for improved elasticity |
-
2013
- 2013-07-12 KR KR1020130082518A patent/KR102155133B1/en active IP Right Grant
-
2014
- 2014-07-11 US US14/904,503 patent/US10528619B2/en active Active
- 2014-07-11 WO PCT/KR2014/006265 patent/WO2015005728A1/en active Application Filing
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030184562A1 (en) * | 2002-03-29 | 2003-10-02 | Nobuyuki Matsumoto | Video object clipping method and apparatus |
US20060008145A1 (en) * | 2004-07-06 | 2006-01-12 | Fuji Photo Film Co., Ltd. | Image data processing apparatus and method, and image data processing program |
WO2009004524A1 (en) | 2007-06-29 | 2009-01-08 | Nokia Corporation | Apparatus, method and computer program product for using images in contact lists maintained in electronic devices |
KR20090003939A (en) | 2007-07-05 | 2009-01-12 | 삼성테크윈 주식회사 | Method for managing character image files of computer |
KR20090118674A (en) | 2008-05-14 | 2009-11-18 | 주식회사 비엔에스웍스 | Digital picture frame capable of offering communication service and method thereof |
US20090303338A1 (en) * | 2008-06-06 | 2009-12-10 | Texas Instruments Incorporated | Detailed display of portion of interest of areas represented by image frames of a video signal |
KR20100000936A (en) | 2008-06-26 | 2010-01-06 | 주식회사 케이티테크 | Method and mobile communication terminal for processing individual information |
KR20100001064A (en) | 2008-06-26 | 2010-01-06 | 주식회사 케이티 | Method and system for searching contents using image recognition at internet protocol televition |
US20110069823A1 (en) | 2009-09-22 | 2011-03-24 | Hon Hai Precision Industry Co., Ltd. | Communication device and communication method thereof |
KR20110083025A (en) | 2010-01-13 | 2011-07-20 | 삼성전자주식회사 | Apparatus and method for storing face image according to time variation |
KR20110128574A (en) | 2010-05-24 | 2011-11-30 | 주식회사 다음커뮤니케이션 | Method for recognizing human face and recognizing apparatus |
US20130044921A1 (en) | 2011-08-18 | 2013-02-21 | Lg Electronics Inc. | Mobile terminal and control method thereof |
KR20130020065A (en) | 2011-08-18 | 2013-02-27 | 엘지전자 주식회사 | Mobile device and control method for the same |
US20150286896A1 (en) * | 2012-05-24 | 2015-10-08 | Hitachi, Ltd. | Image Analysis Device, Image Analysis System, and Image Analysis Method |
Also Published As
Publication number | Publication date |
---|---|
KR20150007899A (en) | 2015-01-21 |
KR102155133B1 (en) | 2020-09-11 |
WO2015005728A1 (en) | 2015-01-15 |
US20160147792A1 (en) | 2016-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10528619B2 (en) | Image display method and device | |
US10775896B2 (en) | Method for controlling display of multiple objects depending on input related to operation of mobile terminal, and mobile terminal therefor | |
US9261995B2 (en) | Apparatus, method, and computer readable recording medium for selecting object by using multi-touch with related reference point | |
AU2014201716B2 (en) | Apparatus and method for providing additional information by using caller phone number | |
US11520476B2 (en) | Electronic apparatus displaying representative information and control method thereof | |
KR102041984B1 (en) | Mobile apparatus having function of face recognition with additional component | |
US10254915B2 (en) | Apparatus, method, and computer-readable recording medium for displaying shortcut icon window | |
EP2720126B1 (en) | Method and apparatus for generating task recommendation icon in a mobile device | |
KR102139526B1 (en) | Apparatus, method and computer readable recording medium for fulfilling a plurality of objects displayed on an electronic device | |
US20160227010A1 (en) | Device and method for providing lock screen | |
US20140279437A1 (en) | Method and apparatus for electronic payment in electronic device | |
EP2811420A2 (en) | Method for quickly executing application on lock screen in mobile device, and mobile device therefor | |
US20140351763A1 (en) | Apparatus, method and computer readable recording medium for displaying thumbnail image of panoramic photo | |
US20180329598A1 (en) | Method and apparatus for dynamic display box management | |
KR20140126140A (en) | Mobile apparatus providing with changed-shortcut icon responding to status of mobile apparatus and control method thereof | |
US20140267384A1 (en) | Display apparatus and control method thereof | |
US10409478B2 (en) | Method, apparatus, and recording medium for scrapping content | |
KR20140136349A (en) | Apparatus saving conversation and method thereof | |
US10114496B2 (en) | Apparatus for measuring coordinates and control method thereof | |
KR20150026110A (en) | A method for managing icons and a mobile terminal therefor | |
US20150067493A1 (en) | Method of modifying text input from user and electronic device therefor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OH, HUN-CHEOL;KIM, SOO-HYUNG;ROH, BYOUNG-TACK;REEL/FRAME:037465/0448 Effective date: 20160111 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |