WO2018020611A1 - Image acquisition system, image acquisition method, and program - Google Patents
Image acquisition system, image acquisition method, and program Download PDFInfo
- Publication number
- WO2018020611A1 WO2018020611A1 PCT/JP2016/072025 JP2016072025W WO2018020611A1 WO 2018020611 A1 WO2018020611 A1 WO 2018020611A1 JP 2016072025 W JP2016072025 W JP 2016072025W WO 2018020611 A1 WO2018020611 A1 WO 2018020611A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- alert
- camera
- permission
- acquisition request
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000010191 image analysis Methods 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 description 23
- 238000003384 imaging method Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 239000004973 liquid crystal related substance Substances 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000010079 rubber tapping Methods 0.000 description 4
- 230000004397 blinking Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 210000003811 finger Anatomy 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000010454 slate Substances 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
Definitions
- the present invention relates to an image acquisition system, an image acquisition method, and a program for acquiring an image captured by a camera.
- an image acquisition system in which an image captured by an imaging device such as a network camera is acquired by a user terminal and the acquired image is displayed on the user terminal.
- the user can acquire an image captured by the designated imaging device by designating the imaging device desired by the user.
- Patent Document 1 when the imaging device captures a person, there is a problem that the person to be imaged captures an image regardless of his / her intention and is displayed on the terminal. It was.
- An object of the present invention is to provide an image acquisition system, an image acquisition method, and a program capable of confirming a person's intention to image when a person is imaged.
- the present invention provides the following solutions.
- the invention according to the first aspect includes an acquisition request notification means for notifying an acquisition request for an image captured by a camera; Permission accepting means for accepting permission for the notified acquisition request; An alert notification means for notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time; Image notification means for acquiring the image after notifying the alert; An image acquisition system is provided.
- the acquisition request of the image captured by the camera is notified, the permission for the notified acquisition request is received, and when the permission is received or when the permission is not received for a certain period of time, After notifying the alert and notifying the alert, the image is acquired.
- the invention according to the first feature is a category of the image acquisition system, but the same actions and effects corresponding to the category are exhibited in other categories such as methods and programs.
- the invention according to the second feature is characterized by: designation means for designating an area of the acquired image; With The image acquisition means acquires an image of the designated area; An image acquisition system that is an invention according to a first feature is provided.
- the image acquisition system which is the invention relating to the first feature designates an area of the obtained image and obtains an image of the designated area.
- the invention according to the third feature is characterized in that, when acquiring the image, voice notification means for notifying a voice at a predetermined time interval;
- An image acquisition system that is an invention according to a first feature is provided.
- the image acquisition system notifies the sound at predetermined time intervals when acquiring the image.
- the invention according to the fourth feature is an image analysis means for image analysis of the acquired image; With The voice notification means changes the content of the voice to be notified based on the result of the image analysis.
- An image acquisition system according to the third feature is provided.
- the image acquisition system performs image analysis on the acquired image and, based on the result of the image analysis, determines the content of the voice to be notified. change.
- the invention according to the fifth feature is a step of notifying an acquisition request for an image captured by the camera; Receiving permission for the notified acquisition request; A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time; Obtaining the image after notifying the alert; and An image acquisition method is provided.
- the invention according to the sixth aspect provides an image acquisition system, A step of notifying an acquisition request for an image captured by the camera; Receiving permission for the notified acquisition request; A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time; Obtaining the image after notifying the alert; Provide a program to execute.
- an image acquisition system an image acquisition method, and a program capable of confirming a person's intention of imaging when imaging a person.
- FIG. 1 is a diagram showing an outline of the image acquisition system 1.
- FIG. 2 is an overall configuration diagram of the image acquisition system 1.
- FIG. 3 is a functional block diagram of the user terminal 100 and the camera 200.
- FIG. 4 is a flowchart showing image acquisition processing executed by the user terminal 100 and the camera 200.
- FIG. 5 is a flowchart showing image acquisition processing executed by the user terminal 100 and the camera 200.
- FIG. 6 is a flowchart showing notification processing executed by the camera 200.
- FIG. 7 is a flowchart showing notification content change processing executed by the camera 200.
- FIG. 8 is a diagram illustrating an example of a state in which the user terminal 100 accepts an area specification.
- FIG. 9 is a diagram illustrating an example of the designated area image displayed on the user terminal 100.
- FIG. 1 is a diagram for explaining an outline of an image acquisition system 1 which is a preferred embodiment of the present invention.
- the image acquisition system 1 includes a user terminal 100 and a camera 200.
- the number of user terminals 100 and cameras 200 is not limited to one and may be plural. Each process described below may be realized by either or both of the user terminal 100 and the camera 200.
- the user terminal 100 is a terminal device possessed by the user that can perform data communication with the camera 200.
- the user terminal 100 is, for example, a cellular phone, a portable information terminal, a tablet terminal, a personal computer, an electric appliance such as a netbook terminal, a slate terminal, an electronic book terminal, a portable music player, a smart glass, a head mounted display, or the like Wearable terminals and other items.
- the camera 200 is an imaging device such as a network camera that can perform data communication with the user terminal 100 and captures images such as moving images and still images.
- the owner of the user terminal 100 will be described as a user A, and the person captured by the camera 200 will be described as a person B.
- the user terminal 100 transmits an acquisition request for acquiring an image captured by the camera 200 to the camera 200 (step S01). For example, the user terminal 100 selects a camera 200 that captures an image desired by the user, and transmits an acquisition request to the camera 200.
- the camera 200 receives the acquisition request, and notifies the acquisition request to the person imaged by the camera 200 (step S02).
- the camera 200 notifies that the user terminal 100 is about to acquire an image.
- the camera 200 notifies the user of “Are you sure to send the captured image to the user A?” From a speaker or the like.
- the camera 200 may notify a person who captures an image with a configuration other than sound that the user terminal 100 is about to acquire an image.
- the camera 200 accepts permission for the acquisition request (step S03).
- the camera 200 accepts a permission by a voice, a gesture, or the like from a person to be imaged.
- the camera 200 accepts the permission by receiving a voice, a gesture or the like that can be generally recognized as permission from the person to be imaged.
- the camera 200 may accept permission by a configuration other than voice or gesture, for example, input by a switch or detection by a sensor.
- a voice or gesture that is recognized as permission may be stored in advance, and if the stored voice or gesture is accepted, the permission may be accepted. Other configurations may also be used.
- the camera 200 notifies an alert when the permission is accepted or when the permission is not accepted for a certain period of time (step S04). For example, the camera 200 notifies an alert by audio output. Specifically, the camera 200 notifies the person to be imaged of an alert by outputting a voice saying “I will send the image to be captured to the user A”. That is, the camera 200 notifies the person B to be imaged of a point at which an image is captured and a point at which the captured image is transmitted to another person. The camera 200 may notify the alert by a configuration other than sound, for example, light, characters, images, and the like.
- the camera 200 captures an image and transmits image data of the captured image to the user terminal 100 (step S05).
- the camera 200 may be configured to notify an alert to a person who captures images at predetermined time intervals while transmitting image data to the user terminal 100.
- the camera 200 outputs a voice message at a predetermined time interval to notify that “currently an image to be captured is being transmitted to the user A”. That is, the camera 200 notifies the person B to be imaged of the point at which an image is being captured and the point at which the image being captured is being transmitted to another person.
- the camera 200 may notify the alert by a configuration other than sound, for example, light, characters, images, or the like.
- the camera 200 may be configured to analyze the image to be captured and change the content of the alert to be notified based on the result of the image analysis. For example, when the camera 200 recognizes that the person B appears in the image as a result of image analysis of the captured image, the camera 200 changes the content of the alert to be notified to “user A You may send a notification to this changed alert. That is, the camera 200 changes to an alert that clearly indicates the point at which the person B is taking an image and is notified. Further, the camera 200 may change the contents of the above-described alert and notify the changed alert even if the configuration is other than audio.
- User terminal 100 receives image data and acquires an image captured by camera 200.
- the user terminal 100 displays an image captured by the camera 200 on itself based on the acquired image (step S06).
- the user terminal 100 may be configured to designate an area of the displayed image and acquire an image of the designated area. For example, the user terminal 100 designates the person B shown in the displayed image, acquires an image of only the person B, or designates a part of the body of the person B, thereby An image of a part of the person's body is acquired, or an image other than the person B is designated to acquire an image other than the person B.
- the user terminal 100 transmits a specified area acquisition request for acquiring an image of the specified area to the camera 200, and the camera 200 determines the image of the area specified by the user terminal 100 based on the specified area acquisition request.
- the designated area image data is transmitted to the user terminal 100.
- FIG. 2 is a diagram showing a system configuration of the image acquisition system 1 which is a preferred embodiment of the present invention.
- the image acquisition system 1 includes a user terminal 100, a camera 200, and a public network (Internet network, third and fourth generation communication network, etc.) 5. Note that the number of user terminals 100 and cameras 200 is not limited to one and may be plural. Each process described below may be realized by either or both of the user terminal 100 and the camera 200.
- the user terminal 100 is the above-described terminal device having the functions described later. In the following description, the owner of the user terminal 100 will be described as a user A.
- the camera 200 is the above-described imaging device having the functions described below. In the following description, a person captured by the camera 200 is described as a person B.
- FIG. 3 is a functional block diagram of the user terminal 100 and the camera 200.
- the user terminal 100 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc. as the control unit 110, and a device for enabling communication with other devices as the communication unit 120.
- a WiFi (Wireless Fidelity) compatible device compliant with IEEE 802.11 is provided.
- the user terminal 100 includes, as the input / output unit 140, a display unit that outputs and displays data and images controlled by the control unit 110, an input unit such as a touch panel, a keyboard, and a mouse that receives input from the user.
- the control unit 110 when the control unit 110 reads a predetermined program, the acquisition request transmission module 150 and the image reception module 151 are realized in cooperation with the communication unit 120. In the user terminal 100, the control unit 110 reads a predetermined program, thereby realizing the input receiving module 170 and the display module 171 in cooperation with the input / output unit 140.
- the camera 200 includes a CPU, RAM, ROM, and the like as the control unit 210, a device for enabling communication with other devices, as the communication unit 220, and the input / output unit 240.
- a display unit an imaging device such as a lens, an image sensor, various buttons, a flash, a sound emitting device such as a speaker, a sound collecting device such as a microphone, and the like.
- the control unit 210 when the control unit 210 reads a predetermined program, the acquisition request reception module 250 and the image transmission module 251 are realized in cooperation with the communication unit 220. In the camera 200, the control unit 210 reads a predetermined program, and thereby cooperates with the input / output unit 240 to obtain an acquisition request notification module 270, a permission reception module 271, an alert notification module 272, an imaging module 273, and an analysis module. 274 is realized.
- FIGS. 4 and 5 are flowcharts of image acquisition processing executed by the user terminal 100 and the camera 200.
- FIG. The processing executed by the modules of each device described above will be described together with this processing.
- the input receiving module 170 receives a selection input of the camera 200 that acquires an image (step S10).
- step S10 for example, the input reception module 170 displays a list of images captured by the plurality of cameras 200 on the display unit, and acquires one or more images from the images, thereby acquiring the images. 200 selection inputs are accepted. Further, the input receiving module 170 receives the input of device information unique to the device such as the location of the camera 200, a specific keyword, a telephone number, a user name, and an IP address, thereby selecting and inputting the camera 200 that acquires an image. Accept.
- the acquisition request transmission module 150 transmits an acquisition request for acquiring an image captured by the camera 200 to the camera 200 that has received the selection input (step S11).
- the acquisition request receiving module 250 receives an acquisition request.
- the acquisition request notification module 270 notifies the acquisition request to a person in the vicinity of the camera 200 (step S12).
- the acquisition request notification module 270 notifies the user terminal 100 that the user terminal 100 is about to acquire an image by voice, light, text, image, or the like.
- the acquisition request notification module 270 notifies the acquisition request by outputting sound from a speaker or the like attached to the camera 200. Specifically, the acquisition request notification module 270 outputs a voice message “Can I send the captured image to the user A?”. Further, the acquisition request notification module 270 notifies the acquisition request by outputting light from a light or the like attached to the camera 200. Specifically, the acquisition request notification module 270 notifies the acquisition request described above by blinking a light or causing a specific color to emit light. Further, the acquisition request notification module 270 notifies the acquisition request by displaying characters on an electric bulletin board attached to the camera 200, a liquid crystal panel, or the like.
- the acquisition request notification module 270 outputs and displays as a text “Can I send the captured image to the user A?”.
- the acquisition request notification module 270 notifies the acquisition request by displaying an image on the above-described electronic bulletin board, liquid crystal panel, or the like.
- the acquisition request notification module 270 outputs and displays an image indicating that an image captured by the camera 200 is transmitted.
- the acquisition request notification module 270 may notify the acquisition request by a configuration other than the configuration described above. Moreover, the structure which notifies an acquisition request by combining two or more structures mentioned above may be sufficient.
- the permission acceptance module 271 determines whether or not permission for the acquisition request has been accepted (step S13).
- step S ⁇ b> 13 the permission receiving module 271 determines whether or not permission has been received based on, for example, whether or not an input of a voice or a gesture from the person B has been received.
- the permission receiving module 271 collects the voice of the person B using a microphone attached to the camera 200 and determines whether the permission is received.
- the permission receiving module 271 determines whether the imaging module 273 has captured a part or all of the body of the person B and has received permission.
- the permission receiving module 271 determines whether or not the person B has made a sound that can be recognized as generally permitted, such as “Okay”, “Allow”, “No problem”, and the like. . In addition, the permission receiving module 271 determines whether or not the person B has executed a generally recognizable gesture such as a gesture of forming a circle with an arm or a finger, a gesture of pointing the thumb up, or a whispering gesture. .
- the permission receiving module 271 may receive permission with a configuration other than the above-described configuration. Further, the permission receiving module 271 may determine whether or not a voice or gesture other than the voice or gesture described above has been executed. Further, it may be determined whether or not the permission is accepted by storing a voice or gesture indicating permission in advance and determining whether or not the stored voice or gesture is accepted. Further, the permission accepting module 271 may accept permission by a configuration other than voice or gesture, for example, input by a switch or detection by a sensor.
- processing in step S13 may be configured to be executed by an external computer (not shown) or the user terminal 100.
- the configuration may be such that the camera 200 transmits data such as received voices and gestures to an external computer and the external computer determines whether or not permission has been received.
- step S13 when the permission receiving module 271 determines that the permission has been received (step S13: YES), the permission receiving module 271 executes a process of step S15 described later.
- step S13 when it is determined in step S13 that the permission receiving module 271 has not received permission (NO in step S13), the permission receiving module 271 determines whether or not a predetermined time has passed (step S14). In step S14, the permission receiving module 271 determines whether or not a predetermined time such as 30 seconds, 1 minute, 3 minutes, or the like has elapsed since the acquisition request was notified.
- the predetermined time may be a time required for the person B to respond to the acquisition request, and the time can be changed as appropriate.
- step S14 when the permission receiving module 271 determines that the predetermined time has not elapsed (NO in step S14), the permission receiving module 271 executes the process of step S13 described above again.
- step S14 when the permission receiving module 271 determines in step S14 that the predetermined time has elapsed (YES in step S14), the alert notification module 272 notifies the alert (step S15).
- step S15 the alert notification module 272 notifies the person B of an alert by voice, light, characters, images, or the like.
- step S15 the alert notification module 272 notifies the person B of an alert by outputting sound from a speaker or the like. Specifically, the alert notification module 272 notifies the person B that the image to be captured is to be transmitted to the user A by outputting a voice message “Start transmitting the image to be captured to the user A”. .
- step S15 the alert notification module 272 notifies the person B of an alert using a light or the like. Specifically, the alert notification module 272 notifies the person B that the image to be captured is to be transmitted to the user A by emitting, blinking, changing the color of the light or the like of the alert described above.
- step S15 the alert notification module 272 notifies the person B of an alert by displaying characters on an electric bulletin board or a liquid crystal panel. Specifically, the alert notification module 272 outputs to the person B that the image to be captured is to be transmitted to the user A by outputting and displaying the characters “Start transmitting the image to be captured to the user A”. Notice.
- step S15 the alert notification module 272 notifies the person B of an alert by displaying an image on an electric bulletin board or a liquid crystal panel. Specifically, the alert notification module 272 outputs and displays an image indicating that an image captured by the camera 200 is about to be transmitted.
- alert notification module 272 may notify the alert by a configuration other than the configuration described above. Moreover, the alert notification module 272 may notify an alert by combining the above-described configurations.
- step S13 the structure which performs only any one of the process of step S13 mentioned above and the process of step S14 may be sufficient.
- step S13 or step S14 the permission receiving module 271 ends this process when receiving a permission to reject.
- This permission is a voice or gesture that can be generally recognized as being rejected.
- the structure which transmits to the user terminal 100 after performing image processing which cannot identify individuals, such as a mosaic may be sufficient as a person at this time.
- the camera 200 transmits image data to the user terminal 100
- the user terminal 100 performs image processing such that a mosaic or the like cannot be identified, and the image processing is performed in step S ⁇ b> 18 described later. It may be configured to display an image subjected to.
- the imaging module 273 captures an image (step S16).
- the image transmission module 251 transmits the image data of the captured image to the user terminal 100 (step S17).
- the image receiving module 151 receives image data.
- the display module 171 displays an image captured by the camera 200 based on the image data (step S18).
- the input receiving module 170 determines whether or not an input for designating an area has been received (step S19).
- step S ⁇ b> 19 the input reception module 170 determines whether or not this input has been received for an image to be displayed by an input device such as a tap operation or a mouse.
- step S19 for example, the input receiving module 170 designates a part or all of the face, eyes, mouth, etc. of the person B shown in the image to be displayed or part or all of the area other than the person B as the area designation. It is determined whether or not it has been accepted.
- FIG. 8 is a diagram illustrating an example of a state in which the input receiving module 170 has received designation of an area.
- the display module 171 displays an image 300 captured by the camera 200.
- the icon 320 schematically shows the hand of the user A.
- the user A designates a desired area 310 by tapping the image 300.
- FIG. 8 shows a state in which the input receiving module 170 has designated the area around the face of the person B as the area 310.
- An area 310 means a part of an image that is to be acquired in a process to be described later by an input from the user A.
- the input receiving module 170 indicates the region 310 by enclosing the region of the image with a line, but may indicate the region 310 with other configurations.
- the input reception module 170 may recognize the entire person as the region 310 by tapping a part of the person. Further, by tapping a part of a person, the tapped part may be recognized as the region 310. Alternatively, a part excluding a person may be recognized as the region 310 by tapping a part other than the person. This may be performed by analyzing the image and identifying each boundary of each person's part, person, background, and the like.
- step S19 when the input reception module 170 determines that the designation has been accepted (YES in step S19), the acquisition request transmission module 150 sends a designated area image acquisition request for obtaining an image of the area in which the designation has been received to the camera 200. Transmit (step S20). In step S20, the acquisition request transmission module 150 transmits a specified area image acquisition request for acquiring an image of only the area for which the specification has been accepted.
- the acquisition request receiving module 250 receives a specified area image acquisition request.
- the image transmission module 251 transmits the image data of the area designated by the user A to the user terminal 100 as the designated area image data based on the received designated area image acquisition request (step S21).
- the image receiving module 151 receives the designated area image data.
- the display module 171 displays the image of the designated area based on the designated area image data (step S22). Thereafter, the user terminal 100 executes a process of step S23 described later.
- FIG. 9 is a diagram showing an example of the designated area image displayed by the display module 171.
- the display module 171 displays the designated area image 400 of the area 310 designated in FIG.
- the display module 171 displays the image 400 in an enlarged size to the same size as the aspect ratio of the image 300 displayed in FIG.
- the display module 171 changes the size of the designated area image 400, but may display it without changing it.
- step S19 when it is determined in step S19 that the input receiving module 170 has not received an input (NO in step S19), the input receiving module 170 determines whether an input of an image acquisition end instruction has been received (step S19). S23). In step S23, for example, the input receiving module 170 determines whether or not an input such as a voice input related to the end instruction from the user A, a gesture input related to the end instruction, and an operation input of the end icon displayed on the display unit has been received. To do.
- step S23 when the input reception module 170 determines that the input is not received (step S23: NO), the process of step S19 described above is executed.
- step S23 when the input receiving module 170 determines in step S23 that the input has been received (YES in step S23), the image receiving module 151 ends the acquisition of the image and ends the present process.
- FIG. 6 is a flowchart of notification processing executed by the camera 200. Processing executed by each module described above will be described together with this processing.
- the image transmission module 251 determines whether image data is being transmitted to the user terminal 100 (step S30). In step S ⁇ b> 30, the image transmission module 251 determines whether image data or designated area image data is being transmitted to the user terminal 100. If the image transmission module 251 determines in step S30 that image data has not been transmitted (NO in step S30), the process ends.
- step S31 the alert notification module 272 determines whether or not a predetermined time has elapsed.
- the predetermined time is, for example, 30 seconds, 1 minute, 2 minutes, 5 minutes, or the like. This predetermined time can be changed as appropriate.
- the alert notification module 272 determines whether or not a predetermined time has elapsed since the start of transmission of image data, and whether or not a predetermined time has elapsed since the previous execution of this process.
- step S31 when the alert notification module 272 determines that the time has not elapsed (NO in step S31), the alert notification module 272 executes the process of step S30 described above.
- step S31 when the alert notification module 272 determines in step S31 that the time has elapsed (YES in step S31), the alert notification module 272 notifies the alert (step S32). In step S32, the alert notification module 272 notifies voice, light, characters, images, etc. as an alert.
- step S32 for example, the alert notification module 272 notifies the person B of an alert by outputting sound from a speaker or the like. Specifically, the alert notification module 272 notifies the person B that the image to be captured is being transmitted to the user A by outputting a voice message “Currently transmitting the captured image to the user A”. To do.
- step S32 for example, the alert notification module 272 notifies the person B of an alert using a light or the like. Specifically, the alert notification module 272 notifies the person B that the image to be captured is being transmitted to the user A by changing the color of light, blinking, or light of the alert described above.
- step S32 the alert notification module 272 notifies the person B of an alert by displaying characters on an electric bulletin board or a liquid crystal panel. Specifically, the alert notification module 272 indicates that the image to be captured is being transmitted to the user A by outputting and displaying the characters “Currently transmitting the captured image to the user A”. Notify
- step S32 for example, the alert notification module 272 notifies the person B of an alert by displaying an image on an electric bulletin board or a liquid crystal panel. Specifically, the alert notification module 272 outputs and displays an image indicating that the camera 200 is currently transmitting an image to the user terminal 100.
- alert notification module 272 may notify the alert by a configuration other than the configuration described above. Moreover, the alert notification module 272 may notify an alert by combining the above-described configurations.
- the image transmission module 251 determines whether the image acquisition is completed (step S33). In step S ⁇ b> 33, the image transmission module 251 determines based on whether the image reception module 151 has finished acquiring images. Note that the image transmission module 251 may determine whether or not the image acquisition has been completed with another configuration.
- step S33 when it is determined that the image transmission module 251 has not ended (step S33: NO), the process of step S30 described above is executed. On the other hand, when the image transmission module 251 determines in step S33 that the processing has ended (YES in step S33), the processing ends.
- Each process described above is executed by the camera 200, but may be configured to be executed by an external computer or user terminal 100 (not shown), or may be configured by the user terminal 100, the camera 200, or an external not shown.
- the configuration may be executed by any one or a combination of computers.
- FIG. 7 is a diagram illustrating a flowchart of notification content change processing executed by the camera 200. Processing executed by each module described above will be described together with this processing. In addition, this process is a process which changes the content of the alert notified in step S32 mentioned above.
- the image transmission module 251 determines whether or not the designated area image data is transmitted (step S40). If the image transmission module 251 determines in step S40 that transmission has not been performed (NO in step S40), the process ends.
- step S40 may be executed based on whether or not normal image data is being transmitted instead of the designated area image data.
- the image transmission module 251 may determine whether or not image data is being transmitted.
- step S40 when the image transmission module 251 determines in step S40 that transmission is in progress (YES in step S40), the analysis module 274 performs image analysis on the designated area image data currently being transmitted, and based on the image analysis result. Then, an object included in the designated area image data is recognized (step S41). In step S41, the analysis module 274 extracts the feature amount of the object included in the designated area image data, and the extracted feature amount and the feature of the object stored in the database stored by itself or the database stored by the external computer. The object included in the designated area image data is recognized by comparing the quantity.
- step S41 the analysis module 274 may recognize an object included in the designated area image data with another configuration.
- the alert notification module 272 changes the content of the alert notified in step S32 described above based on the recognized object (step S42).
- step S42 a case where the object recognized by the analysis module 274 is a person B will be described as an example.
- step S42 the alert notification module 272 changes the content of the notification in step S32 described above as “currently sending an image of the person B to the user A”.
- the alert notification module 272 changes alerts such as voice, light, characters, images, etc. based on the contents of the changed notification and notifies the person B.
- Each process described above is executed by the camera 200, but may be configured to be executed by an external computer or user terminal 100 (not shown), or may be configured by the user terminal 100, the camera 200, or an external not shown.
- the configuration may be executed by any one or a combination of computers.
- the notification content changing process may be executed again when the alert content is changed once or when the designated area image data is changed. That is, it may be executed when a change occurs in the recognized object.
- the above is the notification content change processing.
- the means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program.
- the program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, CD (CD-ROM, etc.), DVD (DVD-ROM, DVD-RAM, etc.).
- the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it.
- the program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Alarm Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
Description
前記通知した取得要求に対する許諾を受け付ける許諾受付手段と、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するアラート通知手段と、
前記アラートを通知した後、前記画像を取得する画像取得手段と、
を備えることを特徴とする画像取得システムを提供する。 The invention according to the first aspect includes an acquisition request notification means for notifying an acquisition request for an image captured by a camera;
Permission accepting means for accepting permission for the notified acquisition request;
An alert notification means for notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Image notification means for acquiring the image after notifying the alert;
An image acquisition system is provided.
を備え、
前記画像取得手段が、前記指定した領域の画像を取得する、
ことを特徴とする第1の特徴に係る発明である画像取得システムを提供する。 The invention according to the second feature is characterized by: designation means for designating an area of the acquired image;
With
The image acquisition means acquires an image of the designated area;
An image acquisition system that is an invention according to a first feature is provided.
を備えることを特徴とする第1の特徴に係る発明である画像取得システムを提供する。 The invention according to the third feature is characterized in that, when acquiring the image, voice notification means for notifying a voice at a predetermined time interval;
An image acquisition system that is an invention according to a first feature is provided.
を備え、
前記音声通知手段が、前記画像解析の結果に基づいて、前記通知する音声の内容を変更する、
ことを特徴とする第3の特徴に係る発明である記載の画像取得システムを提供する。 The invention according to the fourth feature is an image analysis means for image analysis of the acquired image;
With
The voice notification means changes the content of the voice to be notified based on the result of the image analysis.
An image acquisition system according to the third feature is provided.
前記通知した取得要求に対する許諾を受け付けるステップと、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するステップと、
前記アラートを通知した後、前記画像を取得するステップと、
を備えることを特徴とする画像取得方法を提供する。 The invention according to the fifth feature is a step of notifying an acquisition request for an image captured by the camera;
Receiving permission for the notified acquisition request;
A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Obtaining the image after notifying the alert; and
An image acquisition method is provided.
カメラが撮像する画像の取得要求を通知するステップ、
前記通知した取得要求に対する許諾を受け付けるステップ、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するステップ、
前記アラートを通知した後、前記画像を取得するステップ、
を実行させるためのプログラムを提供する。 The invention according to the sixth aspect provides an image acquisition system,
A step of notifying an acquisition request for an image captured by the camera;
Receiving permission for the notified acquisition request;
A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Obtaining the image after notifying the alert;
Provide a program to execute.
本発明の概要について、図1に基づいて説明する。図1は、本発明の好適な実施形態である画像取得システム1の概要を説明するための図である。画像取得システム1は、ユーザ端末100、カメラ200から構成される。ユーザ端末100、カメラ200の数は、1つに限らず複数であってもよい。また、後述する各処理は、ユーザ端末100、カメラ200のいずれか又は双方により実現されてもよい。 [Outline of Image Acquisition System 1]
The outline of the present invention will be described with reference to FIG. FIG. 1 is a diagram for explaining an outline of an
図2に基づいて、画像取得システム1のシステム構成について説明する。図2は、本発明の好適な実施形態である画像取得システム1のシステム構成を示す図である。画像取得システム1は、ユーザ端末100、カメラ200、公衆回線網(インターネット網や、第3、第4世代通信網等)5から構成される。なお、ユーザ端末100、カメラ200は、1つに限らず、複数であってもよい。また、後述する各処理は、ユーザ端末100、カメラ200のいずれか又は双方により実現されてもよい。 [System Configuration of Image Acquisition System 1]
The system configuration of the
図3に基づいて、画像取得システム1の機能について説明する。図3は、ユーザ端末100、カメラ200の機能ブロック図を示す図である。 [Description of each function]
Based on FIG. 3, functions of the
図4及び図5に基づいて、画像取得システム1が実行する画像取得処理について説明する。図4及び図5は、ユーザ端末100、カメラ200が実行する画像取得処理のフローチャートを示す図である。上述した各装置のモジュールが実行する処理について、本処理に併せて説明する。 [Image acquisition processing]
The image acquisition process executed by the
図6に基づいて、画像取得システム1が実行する通知処理について説明する。図6は、カメラ200が実行する通知処理のフローチャートを示す図である。上述した各モジュールが実行する処理について、本処理に併せて説明する。 [Notification processing]
The notification process executed by the
図7に基づいて、画像取得システム1が実行する通知内容変更処理について説明する。図7は、カメラ200が実行する通知内容変更処理のフローチャートを示す図である。上述した各モジュールが実行する処理について、本処理に併せて説明する。なお、本処理は、上述したステップS32において通知するアラートの内容を変更する処理である。 [Notification change processing]
Based on FIG. 7, the notification content changing process executed by the
Claims (6)
- カメラが撮像する画像の取得要求を通知する取得要求通知手段と、
前記通知した取得要求に対する許諾を受け付ける許諾受付手段と、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するアラート通知手段と、
前記アラートを通知した後、前記画像を取得する画像取得手段と、
を備えることを特徴とする画像取得システム。 An acquisition request notification means for notifying an acquisition request for an image captured by the camera;
Permission accepting means for accepting permission for the notified acquisition request;
An alert notification means for notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Image notification means for acquiring the image after notifying the alert;
An image acquisition system comprising: - 前記取得する画像の領域を指定する指定手段と、
を備え、
前記画像取得手段は、前記指定した領域の画像を取得する、
ことを特徴とする請求項1に記載の画像取得システム。 A designation means for designating a region of the acquired image;
With
The image acquisition means acquires an image of the designated area;
The image acquisition system according to claim 1. - 前記画像を取得するとき、所定時間間隔で音声を通知する音声通知手段と、
を備えることを特徴とする請求項1に記載の画像取得システム。 A voice notification means for notifying a voice at a predetermined time interval when acquiring the image;
The image acquisition system according to claim 1, further comprising: - 前記取得した画像を画像解析する画像解析手段と、
を備え、
前記音声通知手段は、前記画像解析の結果に基づいて、前記通知する音声の内容を変更する、
ことを特徴とする請求項3に記載の画像取得システム。 Image analysis means for image analysis of the acquired image;
With
The voice notification means changes the content of the voice to be notified based on the result of the image analysis.
The image acquisition system according to claim 3. - カメラが撮像する画像の取得要求を通知するステップと、
前記通知した取得要求に対する許諾を受け付けるステップと、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するステップと、
前記アラートを通知した後、前記画像を取得するステップと、
を備えることを特徴とする画像取得方法。 Notifying an acquisition request for an image captured by the camera;
Receiving permission for the notified acquisition request;
A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Obtaining the image after notifying the alert; and
An image acquisition method comprising: - 画像取得システムに、
カメラが撮像する画像の取得要求を通知するステップ、
前記通知した取得要求に対する許諾を受け付けるステップ、
前記許諾を受け付けた場合又は一定時間前記許諾を受け付けなかった場合、アラートを通知するステップ、
前記アラートを通知した後、前記画像を取得するステップ、
を実行させるためのプログラム。 In the image acquisition system,
A step of notifying an acquisition request for an image captured by the camera;
Receiving permission for the notified acquisition request;
A step of notifying an alert when the permission is accepted or when the permission is not accepted for a certain period of time;
Obtaining the image after notifying the alert;
A program for running
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018530259A JP6448866B2 (en) | 2016-07-27 | 2016-07-27 | Image acquisition system, image acquisition method and program |
PCT/JP2016/072025 WO2018020611A1 (en) | 2016-07-27 | 2016-07-27 | Image acquisition system, image acquisition method, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/072025 WO2018020611A1 (en) | 2016-07-27 | 2016-07-27 | Image acquisition system, image acquisition method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018020611A1 true WO2018020611A1 (en) | 2018-02-01 |
Family
ID=61015852
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/072025 WO2018020611A1 (en) | 2016-07-27 | 2016-07-27 | Image acquisition system, image acquisition method, and program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6448866B2 (en) |
WO (1) | WO2018020611A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2578424A (en) * | 2018-09-27 | 2020-05-13 | Muir Ip Ltd | Configurable escape room system having one or more elements which are altered based upon user consent |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004260631A (en) * | 2003-02-26 | 2004-09-16 | Sony Ericsson Mobilecommunications Japan Inc | Portable terminal |
JP2005039510A (en) * | 2003-07-14 | 2005-02-10 | Sony Corp | Imaging system and imaging method |
JP2008067008A (en) * | 2006-09-06 | 2008-03-21 | Sharp Corp | Photographing device, photographing method, photographing program, and recording medium |
JP2011170373A (en) * | 2011-04-11 | 2011-09-01 | Fujifilm Corp | Photographing device |
JP2013021409A (en) * | 2011-07-07 | 2013-01-31 | Olympus Imaging Corp | Imaging apparatus, imaging method, and program |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001103462A (en) * | 1999-09-30 | 2001-04-13 | Matsushita Electric Works Ltd | Video monitor system |
JP2001145097A (en) * | 1999-11-16 | 2001-05-25 | Matsushita Electric Ind Co Ltd | Nursing purpose camera apparatus |
JP2005057416A (en) * | 2003-08-01 | 2005-03-03 | Matsushita Electric Ind Co Ltd | Imaging apparatus and imaging method |
-
2016
- 2016-07-27 JP JP2018530259A patent/JP6448866B2/en active Active
- 2016-07-27 WO PCT/JP2016/072025 patent/WO2018020611A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004260631A (en) * | 2003-02-26 | 2004-09-16 | Sony Ericsson Mobilecommunications Japan Inc | Portable terminal |
JP2005039510A (en) * | 2003-07-14 | 2005-02-10 | Sony Corp | Imaging system and imaging method |
JP2008067008A (en) * | 2006-09-06 | 2008-03-21 | Sharp Corp | Photographing device, photographing method, photographing program, and recording medium |
JP2011170373A (en) * | 2011-04-11 | 2011-09-01 | Fujifilm Corp | Photographing device |
JP2013021409A (en) * | 2011-07-07 | 2013-01-31 | Olympus Imaging Corp | Imaging apparatus, imaging method, and program |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2578424A (en) * | 2018-09-27 | 2020-05-13 | Muir Ip Ltd | Configurable escape room system having one or more elements which are altered based upon user consent |
GB2578424B (en) * | 2018-09-27 | 2022-12-21 | Muir Ip Ltd | Configurable escape room system having one or more elements which are altered based upon user consent |
Also Published As
Publication number | Publication date |
---|---|
JP6448866B2 (en) | 2019-01-09 |
JPWO2018020611A1 (en) | 2018-12-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110209952B (en) | Information recommendation method, device, equipment and storage medium | |
CN106663245B (en) | Social alerts | |
CN107533360A (en) | A kind of method for showing, handling and relevant apparatus | |
RU2635238C1 (en) | Method, device and terminal for playing music on basis of photoalbum with people's photographs | |
CN109151044B (en) | Information pushing method and device, electronic equipment and storage medium | |
WO2016115716A1 (en) | Voice playing method and voice playing device | |
CN110798327B (en) | Message processing method, device and storage medium | |
CN108833262B (en) | Session processing method, device, terminal and storage medium | |
CN111343346B (en) | Incoming call pickup method and device based on man-machine conversation, storage medium and equipment | |
CN108701455A (en) | Information processing unit, information processing method and program | |
CN110572716A (en) | Multimedia data playing method, device and storage medium | |
CN112236767A (en) | Electronic device and method for providing information related to an image to an application through an input unit | |
CN112115282A (en) | Question answering method, device, equipment and storage medium based on search | |
JP2015126524A (en) | Remote conference program, terminal device, and remote conference method | |
US20140176689A1 (en) | Apparatus and method for assisting the visually impaired in object recognition | |
JP6448866B2 (en) | Image acquisition system, image acquisition method and program | |
CN104837020A (en) | Video playing method and device | |
CN112866470A (en) | Incoming call processing method and device, electronic equipment and medium | |
CN106412481A (en) | Prompt method and device, and terminals based on VoLTE video call | |
KR102051828B1 (en) | Method of making video communication and device of mediating video communication | |
CN114827651A (en) | Information processing method, information processing device, electronic equipment and storage medium | |
CN105577653B (en) | Establish the method and device of video calling | |
JPWO2015079865A1 (en) | INPUT DEVICE, COMMUNICATION INFORMATION SPECIFICATION METHOD, PROCESSING DEVICE, DISPLAY DEVICE, PROGRAM, AND RECORDING MEDIUM | |
CN114219112A (en) | Health service reservation method, device, server and storage medium | |
CN114816600A (en) | Session message display method, device, terminal and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 2018530259 Country of ref document: JP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16910514 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.05.2019) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16910514 Country of ref document: EP Kind code of ref document: A1 |