WO2015015765A1 - Control apparatus, control method, transmission terminal, transmission method, reception terminal, reception method, and control system - Google Patents

Control apparatus, control method, transmission terminal, transmission method, reception terminal, reception method, and control system Download PDF

Info

Publication number
WO2015015765A1
WO2015015765A1 PCT/JP2014/003875 JP2014003875W WO2015015765A1 WO 2015015765 A1 WO2015015765 A1 WO 2015015765A1 JP 2014003875 W JP2014003875 W JP 2014003875W WO 2015015765 A1 WO2015015765 A1 WO 2015015765A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
transmission terminal
information
reception terminal
transmission
Prior art date
Application number
PCT/JP2014/003875
Other languages
French (fr)
Inventor
Yasushi Katayama
Hideyuki Suzuki
Tomoya Yamaura
Original Assignee
Sony Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corporation filed Critical Sony Corporation
Publication of WO2015015765A1 publication Critical patent/WO2015015765A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/64Details of telephonic subscriber devices file transfer between terminals

Definitions

  • the present disclosure relates to a control apparatus, a control method, a transmission terminal, a transmission method, a reception terminal, a reception method, and a control system.
  • time may be necessary in order to recognize the two-dimensional bar code. Further, time may be necessary in order to specify data corresponding to the two-dimensional bar code. Accordingly, it is desirable for technology to be implemented capable of reducing the time which may be necessary for storing desired data in a terminal.
  • a control apparatus including an information acquisition section which acquires information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
  • a control method including acquiring information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal, obtaining a comparison result by comparing the information of the display image and the information of the captured image, and controlling whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
  • a transmission terminal including a communication control section which causes a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
  • a transmission method including causing a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
  • a reception terminal including a communication control section which causes a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
  • a reception method including causing a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
  • a control system including a control apparatus, a transmission terminal, and a reception terminal.
  • the control apparatus includes an information acquisition section which acquires information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
  • the transmission terminal includes a communication control section which causes a communication section to perform data communication to the reception terminal, in a case where it is judged that the comparison result shows matching or a similarity.
  • the reception terminal includes a communication control section which causes a communication section to receive data from the transmission terminal, in a case where it is judged that the comparison result shows matching or a similarity.
  • FIG. 1 is a figure for describing a functional outline of a general control system.
  • FIG. 2 is a sequence diagram which shows an operation example (example in which a transmission terminal selects a connection partner) of a general control system.
  • FIG. 3 is a sequence diagram which shows an operation example (example in which a reception terminal selects a connection partner) of a general control system.
  • FIG. 4 is a figure for describing a functional outline of a control system according to a first embodiment of the present disclosure.
  • FIG. 5 is a figure which shows a functional configuration example of the transmission terminal according to the first embodiment of the present disclosure.
  • FIG. 6 is a figure which shows a functional configuration example of the reception terminal according to the first embodiment of the present disclosure.
  • FIG. 1 is a figure for describing a functional outline of a general control system.
  • FIG. 2 is a sequence diagram which shows an operation example (example in which a transmission terminal selects a connection partner) of a general control system.
  • FIG. 7 is a sequence diagram which shows an operation example (example in which the transmission terminal selects a connection partner) of the control system according to the first embodiment of the present disclosure.
  • FIG. 8 is a sequence diagram which shows an operation example (example in which the reception terminal selects a connection partner) of the control system according to the first embodiment of the present disclosure.
  • FIG. 9 is a sequence diagram which shows an operation example (example in which the transmission terminal performs imaging) of the control system according to the first embodiment of the present disclosure.
  • FIG. 10 is a sequence diagram which shows an operation example (example in which a video image and an application are transmitted in parallel) of the control system according to the first embodiment of the present disclosure.
  • FIG. 11 is a sequence diagram which shows an operation example (example in which a transmission line of data is switched) of the control system according to the first embodiment of the present disclosure.
  • FIG. 12 is a figure which shows a functional configuration example of the transmission terminal according to a second embodiment of the present disclosure.
  • FIG. 13 is a figure which shows a functional configuration example of the reception terminal according to the second embodiment of the present disclosure.
  • FIG. 14 is a sequence diagram which shows an operation example (example in which the transmission terminal selects a connection partner) of the control system according to the second embodiment of the present disclosure.
  • FIG. 15 is a sequence diagram which shows an operation example (example in which the reception terminal selects a connection partner) of the control system according to the second embodiment of the present disclosure.
  • FIG. 12 is a figure which shows a functional configuration example of the transmission terminal according to a second embodiment of the present disclosure.
  • FIG. 13 is a figure which shows a functional configuration example of the reception terminal according to the second embodiment of the present disclosure.
  • FIG. 16 is a diagram which shows a functional configuration example of the transmission terminal according to a third embodiment of the present disclosure.
  • FIG. 17 is a figure which shows a functional configuration example of the reception terminal according to the third embodiment of the present disclosure.
  • FIG. 18 is a figure which shows a functional configuration example of a server apparatus according to the third embodiment of the present disclosure.
  • FIG. 19 is a sequence diagram which shows an operation example of the control system according to the third embodiment of the present disclosure.
  • FIG. 20 is a figure which shows a hardware configuration example of each of the transmission terminal and the reception terminal according to an embodiment of the present disclosure.
  • FIG. 21 is a figure which shows a hardware configuration example of the server apparatus according to an embodiment of the present disclosure.
  • the First Embodiment 1-1 Functional outline of the control system 1-2. Functional configuration example of the transmission terminal 1-3. Functional configuration example of the reception terminal 1-4. Operation examples of the control system 2.
  • the Second Embodiment 2-1 Functional configuration example of the transmission terminal 2-2.
  • Functional configuration example of the reception terminal 2-3 Operation examples of the control system 3.
  • the Third Embodiment 3-1 Functional configuration example of the transmission terminal 3-2.
  • Functional configuration example of the server apparatus 3-4 Operation example of the control system 4.
  • FIG. 1 is a figure for describing a functional outline of a general control system 90.
  • the control system 90 includes a transmission terminal 700 and a reception terminal 800.
  • Applications are executed in the transmission terminal 700, and a video image Im1 is displayed as an execution result of the application.
  • a case is considered in which a user wants to display the video image Im1 on the reception terminal 800 at the time when viewing the video image Im1.
  • a connection process between the transmission terminal 700 and the reception terminal 800 starts.
  • a window D93 which indicates that the video image Im1 will be displayed on the transmission terminal 700
  • the reception terminal 800 displays the video image Im1.
  • control system 90 operates in accordance with Wi-Fi Direct (registered trademark), as an example, in the following sequence charts.
  • FIG. 2 is a sequence diagram which shows an operation example of the general control system 90.
  • the example shown in FIG. 2 corresponds to an example in which the transmission terminal 700 selects a connection partner.
  • each of the transmission terminal 700 and the reception terminal 800 transmit a detection signal for detecting a terminal in the surroundings (S901).
  • the transmission terminal 700 displays a window D91 which inquires whether or not to transmit a connection request to this reception terminal 800 (S902).
  • the transmission terminal 700 transmits a connection request to the reception terminal 800 (S904).
  • the reception terminal 800 displays a window D92 which inquires whether or not to accept the connection request from the transmission terminal 700 (S905).
  • the reception terminal 800 transmits a connection response to the transmission terminal 700 (S907), and the transmission terminal 700 transmits a confirmation message to the reception terminal 800 (S908).
  • the reception terminal 800 displays a window D93 which indicates that the video image Im1 of the transmission terminal 700 will be displayed (S913).
  • the transmission terminal 700 transmits the video image Im1 to the reception terminal 800 by the RTP (S914), and when the video image Im1 is received from the transmission terminal 700, the reception terminal 800 displays the video image Im1 (S915).
  • FIG. 3 is a sequence diagram which shows an operation example of the general control system 90.
  • the example shown in FIG. 3 corresponds to an example in which the reception terminal 800 selects a connection partner.
  • each of the transmission terminal 700 and the reception terminal 800 transmit a detection signal for detecting a terminal in the surroundings (S901).
  • the reception terminal 800 displays a window D91 which inquires whether or not to transmit a connection request to this transmission terminal 700 (S902).
  • the reception terminal 800 transmits a connection request to the transmission terminal 700 (S904).
  • the transmission terminal 700 displays a window D92 which inquires whether or not to accept the connection request from the reception terminal 800 (S905).
  • the transmission terminal 700 transmits a connection response to the reception terminal 800 (S907), and the reception terminal 800 transmits a confirmation message to the transmission terminal 700 (S908).
  • the reception terminal 800 displays a window D93 which indicates that the video image Im1 of the transmission terminal 700 will be displayed (S913).
  • the transmission terminal 700 transmits the video image Im1 to the reception terminal 800 by the RTP (S914), and when the video image Im1 is received from the transmission terminal 700, the reception terminal 800 displays the video image Im1 (S915).
  • a window D93 is displayed which indicates that a video image Im1 of the transmission terminal 700 will be displayed, and the video image Im1 is suddenly displayed subsequent to the window D93.
  • a progress bar can also be displayed which shows the progress condition of the connection process while the connection process is being performed.
  • a case will be assumed in which a two-dimensional bar code is attached to the video image Im1 displayed by the transmission terminal 700.
  • the reception terminal 800 when the user moves the reception terminal 800 so as to fit the two-dimensional bar code within an imaging range, and takes a photograph, it is possible for the reception terminal 800 to recognize the two-dimensional bar code from the captured image and to receive the video image Im1 corresponding to the two-dimensional bar code.
  • time may be necessary in order to recognize the two-dimensional bar code. Further, time may be necessary in order to specify data corresponding to the two-dimensional bar code.
  • technology is proposed capable of reducing the time which may be necessary for storing desired data in the reception terminal 800.
  • a control apparatus 300 which controls data transmission from a transmission terminal 100 to a reception terminal 200, is incorporated into the reception terminal 200.
  • the control apparatus 300 may not necessarily be incorporated into the reception terminal 200, such as will be described in the other embodiments.
  • FIG. 4 is a figure for describing a functional outline of the control system 10 according to the first embodiment of the present disclosure.
  • the control system 10 includes a transmission terminal 100 and a reception terminal 200.
  • An application is executed in the transmission terminal 100, and a video image Im1 is displayed as an execution result of the application.
  • a case is considered in which a user wants to display the video image Im1 on the reception terminal 200 at the time when viewing the video image Im1.
  • a captured video image Im0 is displayed by the reception terminal 200.
  • a connection process between the transmission terminal 100 and the reception terminal 200 may be started. Further, when the connection process between the transmission terminal 100 and the reception terminal 200 is completed, the transmission terminal 100 may transmit the video image Im1 to the reception terminal 200, and the reception terminal 200 may display the video image Im1.
  • the feature amounts extracted from the images are not particularly limited, and for example, may be histograms representing a distribution of colors of the images, or may be histograms representing a distribution of luminance. Further, the feature amounts extracted from the images may be object regions recognized from the images, or may be face regions recognized from the images.
  • the present embodiment will described a case in which the transmission terminal 100 and the reception terminal 200 are connected via a wireless LAN (Local Area Network), for example, and communication is capable of being performed between the transmission terminal 100 and the reception terminal 200 via the wireless LAN.
  • communication between the transmission terminal 100 and the reception terminal 200 may be by wireless communication not via the wireless LAN (for example, infrared communication or the like), or may be by wired communication.
  • the type of terminal for each of the transmission terminal 100 and the reception terminal 200 is not particularly limited.
  • the type of terminal for each of the transmission terminal 100 and the reception terminal 200 may be a video camera, may be a smart phone, or may be a PDA (Personal Digital Assistant).
  • the type of terminal for each of the transmission terminal 100 and the reception terminal 200 may be a PC (Personal Computer), may be a mobile phone, may be a portable music playback apparatus, may be a mobile video processing apparatus, or may be a portable game machine.
  • FIG. 5 is a figure which shows a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure.
  • the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170.
  • control section 110 corresponds to a processor such as a CPU (Central Processing Unit).
  • the control section 110 exhibits the various functions of the control section 110, by executing programs stored in the storage section 150 or another storage medium.
  • the control section 110 has a display control section 111, a captured image acquisition section 112, and a communication control section 113. Each of these functional sections of the control section 110 will be described afterwards.
  • the input section 120 has a function which accepts an operation from a user.
  • the input section 120 outputs the operation accepted from the user to the control section 110.
  • the operation can be used for the execution of a program. Further, for example, the input section 120 can accept an operation from the user which starts the activation of a program. Further, for example, the input section 120 can accept an operation from the user which completes the execution of a program. While the input section 120 is incorporated into the transmission terminal 100 in the example shown in FIG. 5, the input section 120 may be present outside of the transmission terminal 100.
  • the imaging section 130 acquires a captured image by capturing an imaging range, and outputs the captured image to the control section 110.
  • the imaging section 130 performs imaging by imaging magnification set in accordance with an operation input to the input section 120. While an adjustment of the imaging magnification can be implemented by a zoom function, this zoom function is not particularly limited, and may be an optical zoom function, or may be an electronic zoom function. Note that, while the imaging section 130 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the imaging section 130 may be constituted separately from the transmission terminal 100.
  • the detection section 140 detects prescribed sensor data, and outputs the detected sensor data to the control section 110.
  • the detection section 140 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the present position of the transmission terminal 100) by using GPS signals received by the GPS antenna.
  • GPS Global Positioning System
  • the sensor data detected by the detection section 140 may be data other than GPS data.
  • the detection section 140 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the detection section 140 may be constituted separately from the transmission terminal 100.
  • the storage section 150 stores programs for operating the control section 110, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 150 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 150 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the storage section 150 may be constituted separately from the transmission terminal 100.
  • the communication section 160 is capable of communicating with the reception terminal 200.
  • the form of the communication by the communication section 160 is not particularly limited, and the communication by the communication section 160 may be wireless communication, or may be wired communication. Note that, while the communication section 160 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the communication section 160 may be constituted separately from the transmission terminal 100.
  • the display section 170 performs display of various types of information, in accordance with a control by the control section 110.
  • the display section 170 may include an LCD (Liquid Crystal Display), or an organic EL (Electroluminescence) display apparatus.
  • the display section 170 may include an audio output apparatus such as a speaker or headphones. Note that, while the display section 170 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the display section 170 may be constituted separately from the transmission terminal 100.
  • the communication control section 113 causes the communication section 160 to perform data communication to the reception terminal 200. According to such a function of the communication control section 113, it becomes possible to reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, while reducing the complexity of operations provided to a user.
  • the data transmitted to the reception terminal 200 is not particularly limited, and may be at least a video image, or may be at least an application.
  • the information of a display image and the information of a captured image are each not particularly limited.
  • the information of a display image may include a feature amount extracted from the display image
  • the information of a captured image may include a feature amount extracted from the captured image.
  • time may be necessary in order to extract a feature amount from the image
  • the transmission of a feature amount will be more appropriate from the viewpoint of security than the transmission of the image itself prior to the completion of the connection process between the transmission terminal 100 and the reception terminal 200.
  • the information of the display image may include a part or all of the display image
  • the information of the captured image may include a part or all of the captured image.
  • the information of the display image is not limited to a feature amount of the display image
  • the information of the captured image is not limited to a feature amount of the captured image.
  • the transmitted video image may be any type of video image, and may include at least a video image Im1 displayed by the transmission terminal 100.
  • the transmitted video image may be any type of video image, and may include at least a video image Im1 displayed by the transmission terminal 100.
  • the transmitted application may be any type of application, and may include at least an application executed by the transmission terminal 100. In such a case, it becomes possible to store this application itself in the reception terminal 200, at the time when a user becomes interested in the application executed by the transmission terminal 100.
  • the display control section 111 may have a function similar to that of the display control section 211.
  • the control apparatus 300 includes an information acquisition section 311, a comparison section 312, and a transmission control section 313.
  • the information acquisition section 311 acquires a feature amount of a display image displayed by one terminal out of the transmission terminal 100 and the reception terminal 200, and a feature amount of a captured image captured by the other terminal.
  • the comparison section 312 obtains a comparison result by comparing the feature amount of the display image and the feature amount of the captured image.
  • the transmission control section 313 controls whether or not data is transmitted from the transmission terminal 100 to the reception terminal 200 in accordance with the comparison result. For example, in the case where the comparison result shows matching or similarities between the feature amount of the display image and the feature amount of the captured image, the transmission control section 313 may allow data to be transmitted from the transmission terminal 100 to the reception terminal 200.
  • FIG. 6 is a figure which shows a functional configuration example of the reception terminal 200 according to the first embodiment of the present disclosure.
  • the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270.
  • control section 210 corresponds to a processor such as a CPU (Central Processing Unit).
  • the control section 210 exhibits the various functions of the control section 210, by executing programs stored in the storage section 250 or another storage medium.
  • the control section 210 has a display control section 211, a captured image acquisition section 212, and a communication control section 213. Each of these functional sections of the control section 210 will be described afterwards.
  • the input section 220 has a function which accepts an operation from a user.
  • the input section 220 outputs the operation accepted from the user to the control section 210.
  • the operation can be used for the execution of a program. Further, for example, the input section 220 can accept an operation from the user which starts the activation of a program. Further, for example, the input section 220 can accept an operation from the user which completes the execution of a program. While the input section 220 is incorporated into the reception terminal 200 in the example shown in FIG. 6, the input section 220 may be present outside of the reception terminal 200.
  • the imaging section 230 acquires a captured image by capturing an imaging range, and outputs the captured image to the control section 210.
  • the imaging section 230 performs imaging by imaging magnification set in accordance with an operation input to the input section 220. While an adjustment of the imaging magnification can be implemented by a zoom function, this zoom function is not particularly limited, and may be an optical zoom function, or may be an electronic zoom function. Note that, while the imaging section 230 is integrated with the reception terminal 200 in the example shown in FIG. 6, the imaging section 230 may be constituted separately from the reception terminal 200.
  • the detection section 240 detects prescribed sensor data, and outputs the detected sensor data to the control section 210.
  • the detection section 240 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the present position of the reception terminal 200) by using GPS signals received by the GPS antenna.
  • GPS Global Positioning System
  • the sensor data detected by the detection section 240 may be data other than GPS data.
  • the detection section 240 is integrated with the reception terminal 200 in the example shown in FIG. 6, the detection section 240 may be constituted separately from the reception terminal 200.
  • the storage section 250 stores programs for operating the control section 210, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 250 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 250 is integrated with the reception terminal 200 in the example shown in FIG. 6, the storage section 250 may be constituted separately from the reception terminal 200.
  • the communication section 260 is capable of communicating with the transmission terminal 100.
  • the form of the communication by the communication section 260 is not particularly limited, and the communication by the communication section 260 may be wireless communication, or may be wired communication. Note that, while the communication section 260 is integrated with the reception terminal 200 in the example shown in FIG. 6, the communication section 260 may be constituted separately from the reception terminal 200.
  • the display section 270 performs display of various types of information, in accordance with a control by the control section 210.
  • the display section 270 may include an LCD (Liquid Crystal Display), or an organic EL (Electroluminescence) display apparatus.
  • the display section 270 may include an audio output apparatus such as a speaker or headphones. Note that, while the display section 270 is integrated with the reception terminal 200 in the example shown in FIG. 6, the display section 270 may be constituted separately from the reception terminal 200.
  • the communication control section 213 causes the communication section 260 to receive data from the transmission terminal 100. According to such a function of the communication control section 213, it becomes possible to reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, while reducing the complexity of operations provided to the user.
  • the display control section 211 displays a video image on the display section 270, based on the data received from the transmission terminal 100.
  • FIG. 7 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure.
  • the example shown in FIG. 7 corresponds to an example in which the transmission terminal 100 selects a connection partner.
  • the example shown in FIG. 7 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • the communication control section 113 in the transmission terminal 100 transmits a detection signal for detecting a terminal in the surroundings
  • the communication control section 213 in the reception terminal 200 transmits a detection signal for detecting a terminal in the surroundings (S101).
  • the communication control section 213 controls the communication section 260 so as to notify the terminal in the surroundings that connection to a camera is possible (S102). Note that, it may not be necessary to notify that connection to a camera is possible.
  • the display control section 111 displays an image on the display section 170 (S103), and when a feature amount of the display image is extracted (S104), the communication control section 113 controls the communication section 160 so that the feature amount of the display image is transmitted to the terminal in the surroundings (S108).
  • an image is captured by the imaging section 230 (S105), a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), and when the feature amount of the display image and the feature amount of the captured image are acquired by the information acquisition section 311, the comparison section 312 compares both feature amounts (S110).
  • the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109).
  • the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111), and the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
  • the communication control section 113 controls the communication section 160 so that a video image Im1 is transmitted to the reception terminal 200 by the RTP (S117), and when the communication control section 213 controls the communication section 260 so that the video image Im1 is received from the transmission terminal 100, the display control section 211 displays the video image Im1 on the display section 270.
  • the display control section 211 may display a video image Im0 captured by the imaging section 230 on the display section 270, such as shown in FIG. 7. In such a case, when data is received from the transmission terminal 100, the display control section 211 performs a transition of the display by the display section 270 from the video image Im0 captured by the imaging section 230 to the video image Im1 based on data received from the transmission terminal 100.
  • the display image displayed by the transmission terminal 100 and the captured image captured by the reception terminal 200 may be still images or may be moving images.
  • time may be necessary to some extent from the display image being displayed up until the captured image is captured. Therefore, in the case where the display image and the captured image are moving images, and in the case where a difference between the time when the display image is acquired and the time when the captured image is acquired is within a prescribed range, the comparison section 312 may compare a feature amount of the display image and a feature amount of the captured image.
  • the data transmitted to the reception terminal 200 may include at least an application execution state in the transmission terminal 100 and a file generated by an application execution.
  • the application execution state is stored in the RAM 803
  • the file generated by the application execution is stored in the storage apparatus 811.
  • the display by the reception terminal 200 may be changed according to whether or not communication between the transmission terminal 100 and the reception terminal 200 is possible via the wireless LAN.
  • the display control section 211 switches the display by the display section 270 from the video image to an execution result of an application based on the application result state and the file, in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance. According to such a configuration, it becomes possible to resume an image display in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
  • FIG. 8 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure.
  • the example shown in FIG. 8 corresponds to an example in which the reception terminal 200 selects a connection partner.
  • the example shown in FIG. 8 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • S101 to S108 and S110 shown in FIG. 8 can be executed the same as S101 to S108 and S110 shown in FIG. 7. Further, S113 to S117 shown in FIG. 8 can be executed the same as S113 to S117 shown in FIG. 7. Therefore, here, S109, S111 and S112 shown in FIG. 8 will be mainly described.
  • the transmission control section 313 controls the communication section 260 so that a connection request is transmitted to this transmission terminal 100 (S109).
  • the communication control section 113 controls the communication section 160 so that the connection request is received from the reception terminal 200
  • the communication control section 113 controls the communication section 160 so that a connection response is transmitted to the reception terminal 200 (S111)
  • the communication control section 213 controls the communication section 260 so that a confirmation message is transmitted to the transmission terminal 100 (S112).
  • FIG. 9 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure.
  • the example shown in FIG. 9 corresponds to an example in which the transmission terminal 100 captures an image, and the reception terminal 200 displays an image.
  • the example shown in FIG. 9 corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • S101 and S102 shown in FIG. 9 can be executed the same as S101 and S102 shown in FIG. 7 or FIG. 8. Further, S108 to S117 shown in FIG. 9 can be executed the same as S108 to S117 shown in FIG. 7 or FIG. 8. Therefore, here, S103 to S107 shown in FIG. 9 will be mainly described.
  • the display control section 211 displays an image on the display section 270 (S103), and extracts a feature amount of the display image (S104).
  • an image is captured by the imaging section 130 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 112 (S107), the communication control section 113 controls the communication section 160 so that the feature amount of the captured image is transmitted to a terminal in the surroundings (S108).
  • the display control section 211 may display a prescribed image Im2 on the display section 270, such as shown in FIG. 9.
  • the image Im2 can be any type of image, and may be an image obtained by capturing some terminal, such as shown in FIG. 9.
  • the display control section 211 may perform a transition of the display by the display section 270 from the image Im2 to a video image Im1 based on data received from the transmission terminal 100.
  • FIG. 10 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure.
  • the example shown in FIG. 10 corresponds to an example in which a video image and an application are transmitted in parallel.
  • S101 to S117 shown in FIG. 7 to FIG. 9 have already been executed, and the operations which can be additionally performed after this will be mainly described.
  • a distance between the transmission terminal 100 and the reception terminal 200 is determined (S123), and in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance, the display control section 211 may perform a transition of the display by the display section 270 from the video image to an execution result of the application based on the application execution state and the file (S124).
  • the display control section 211 may perform preparations for displaying an execution result of the application based on the application execution state and the file while displaying the video image on the display section 270, and may switch the display by the display section 270 from the video image to the execution result of the application at the time when a prescribed timing is reached. According to such a configuration, it becomes possible for video image display to be smoothly continued in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
  • FIG. 11 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure.
  • the example shown in FIG. 11 corresponds to an example in which a transmission line of data is switched.
  • S101 to S117 shown in FIG. 7 to FIG. 9 have already been executed, and the operations which can be additionally performed after this will be mainly described.
  • the communication control section 113 may switch the transmission line of data transmitted by the communication section 160 from the wireless LAN to a public wireless network. According to such a configuration, it is possible to continue to transmit data from the transmission terminal 100 to the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
  • an application, an application execution state and a file generated by an application result may be transmitted from the transmission terminal 100 to the reception terminal 200 in parallel with the transmission of the video image.
  • the display control section 211 may perform preparations for displaying an execution result of the application based on the application execution state and the file while displaying the video image on the display section 270, and may switch the display by the display section 270 from the video image to the execution result of the application at the time when a prescribed timing is reached. According to such a configuration, it becomes possible for video image display to be smoothly continued in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
  • the control apparatus 300 which controls data transmission from the transmission terminal 100 to the reception terminal 200, is incorporated into the transmission terminal 100.
  • the control apparatus 300 may not necessarily be incorporated into the transmission terminal 100.
  • a description for elements in the second embodiment which are similar to those of the first embodiment will be omitted, and a description will be mainly made for elements in the second embodiment different to those of the first embodiment.
  • FIG. 12 is a figure which shows a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure.
  • the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170.
  • the transmission terminal 100 includes the control apparatus 300.
  • FIG. 13 is a figure which shows a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure.
  • the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270.
  • the transmission terminal 100 includes the control apparatus 300 instead of the reception terminal 200.
  • FIG. 14 is a sequence diagram which shows an operation example of the control system 10 according to the second embodiment of the present disclosure.
  • the example shown in FIG. 14 corresponds to an example in which the transmission terminal 100 selects a connection partner.
  • the example shown in FIG. 14 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • S101 to S107 shown in FIG. 14 can be executed the same as S101 to S107 shown in FIG. 8. Further, S113 to S117 shown in FIG. 14 can be executed the same as S113 to S117 shown in FIG. 8. Therefore, here, S108 to S112 shown in FIG. 14 will be mainly described.
  • the display control section 111 displays an image on the display section 170 (S103), and extracts a feature amount of the display image (S104).
  • an image is captured by the imaging section 230 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), the communication control section 213 controls the communication section 260 so that the feature amount of the captured image is transmitted to a terminal in the surroundings (S108).
  • the comparison section 312 compares both feature amounts (S110).
  • the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109).
  • the communication control section 213 controls the communication section 260 so that the connection request is received from the transmission terminal 100
  • the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111)
  • the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
  • FIG. 15 is a sequence diagram which shows an operation example of the control system 10 according to the second embodiment of the present disclosure.
  • the example shown in FIG. 15 corresponds to an example in which the reception terminal 200 selects a connection partner.
  • the example shown in FIG. 15 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • S101 to S108 and S110 shown in FIG. 15 can be executed the same as S101 to S108 and S110 shown in FIG. 14. Further, S113 to S117 shown in FIG. 15 can be executed the same as S113 to S117 shown in FIG. 14. Therefore, here, S109, S111 and S112 shown in FIG. 15 will be mainly described.
  • the transmission control section 313 controls the communication section 260 so that a connection request is transmitted to this transmission terminal 100 (S109).
  • the communication control section 113 controls the communication section 160 so that the connection request is received from the reception terminal 200
  • the communication control section 113 controls the communication section 160 so that a connection response is transmitted to the reception terminal 200 (S111)
  • the communication control section 213 controls the communication section 260 so that a confirmation message is transmitted to the transmission terminal 100 (S112).
  • the control apparatus 300 which controls data transmission from the transmission terminal 100 to the reception terminal 200, is incorporated into a server apparatus 400 different to the transmission terminal 100 and the reception terminal 200.
  • the control apparatus 300 may not necessarily be incorporated into the server apparatus 400.
  • a description for elements in the third embodiment which are similar to those of the other embodiments will be omitted, and a description will be mainly made for elements in the third embodiment different to those of the other embodiments.
  • FIG. 16 is a figure which shows a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure.
  • the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170.
  • the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
  • FIG. 17 is a figure which shows a functional configuration example of the reception terminal 200 according to the third embodiment of the present disclosure.
  • the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270.
  • the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
  • FIG. 18 is a figure which shows a functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure.
  • the server apparatus 400 includes a control section 410, a storage section 450, and a communication section 460.
  • the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
  • control section 410 corresponds to a processor such as a CPU (Central Processing Unit).
  • CPU Central Processing Unit
  • the control section 410 exhibits the various functions of the control section 410, by executing programs stored in the storage section 450 or another storage medium.
  • the storage section 450 stores programs for operating the control section 410, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 450 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 450 is integrated with the server apparatus 400 in the example shown in FIG. 18, the storage section 450 may be constituted separately from the server apparatus 400.
  • the communication section 460 is capable of communicating with the transmission terminal 100 and the reception terminal 200.
  • the form of the communication by the communication section 460 is not particularly limited, and the communication by the communication section 460 may be wireless communication, or may be wired communication. Note that, while the communication section 460 is integrated with the server apparatus 400 in the example shown in FIG. 18, the communication section 460 may be constituted separately from the server apparatus 400.
  • FIG. 19 is a sequence diagram which shows an operation example of the control system 10 according to the third embodiment of the present disclosure.
  • the example shown in FIG. 19 corresponds to an example in which the transmission terminal 100 selects a connection partner.
  • the example shown in FIG. 19 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
  • S113 to S117 shown in FIG. 19 can be executed the same as S113 to S117 shown in FIG. 7. Therefore, here, S101 to S112 shown in FIG. 19 will be mainly described.
  • the communication control section 113 in the transmission terminal 100 transmits a detection signal for detecting a terminal in the surroundings
  • the communication control section 213 in the reception terminal 200 transmits a detection signal for detecting a terminal in the surroundings (S101).
  • the communication control section 213 controls the communication section 260 so as to notify the terminal in the surroundings that connection to a camera is possible (S102). Note that, it may not be necessary to notify that connection to a camera is possible.
  • the display control section 111 displays an image on the display section 170 (S103), and when a feature amount of the display image is extracted (S104), the communication control section 113 controls the communication section 160 so that the feature amount of the display image and additional information are transmitted to the server apparatus 400 (S108A).
  • an image is captured by the imaging section 230 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), the communication control section 213 controls the communication section 160 so that the feature amount of the captured image and additional information are transmitted to the server apparatus 400 (S108B).
  • the additional information is information additionally used other than the feature amount, and may be sensor data (for example, position information, reception intensities of electric waves, or a feature amount of audio data) detected by the detection section 140, or may be an IP address.
  • the comparison section 312 may additionally compare the additional information acquired from the transmission terminal 100 and the additional information acquired from the reception terminal 200. According to such a configuration, it becomes possible to further reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, compared to the case where only the feature amounts are to be compared.
  • the additional information is information additionally used other than the feature amounts, it is not information which may necessarily have to be provided.
  • the comparison section 312 compares both feature amounts and both additional information (S110).
  • the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109).
  • the communication control section 213 controls the communication section 260 so that the connection request is received from the transmission terminal 100
  • the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111)
  • the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
  • FIG. 20 is a figure which shows a hardware configuration example of the transmission terminal 100 according to an embodiment of the present disclosure.
  • the hardware configuration example shown in FIG. 20 merely shows one example of a hardware configuration of the transmission terminal 100. Therefore, the hardware configuration of the transmission terminal 100 is not limited to the example shown in FIG. 20.
  • the hardware of the reception terminal 200 can also be configured the same as that of the hardware of the transmission terminal 100.
  • the transmission terminal 100 includes a CPU (Central Processing Unit) 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, a sensor 804, an input apparatus 808, an output apparatus 810, a storage apparatus 811, a drive 812, an imaging apparatus 813, and a communication apparatus 815.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • sensor 804 an input apparatus 808, an output apparatus 810, a storage apparatus 811, a drive 812, an imaging apparatus 813, and a communication apparatus 815.
  • the CPU 801 functions as a calculation processing apparatus and a control apparatus, and controls all the operations within the transmission terminal 100 in accordance with various programs. Further, the CPU 801 may be a microprocessor.
  • the ROM 802 stores programs, calculation parameters or the like which are used by the CPU 801.
  • the RAM 803 temporarily stores programs used in the execution of the CPU 801, parameters which arbitrarily change in this execution, or the like. These sections are mutually connected by a host bus constituted from a CPU bus or the like.
  • the sensor 804 is constituted from a sensor for detecting a state of the transmission terminal 100 and this peripheral circuit.
  • a GPS antenna, an inclination sensor, an acceleration sensor, a direction sensor, a temperature sensor, a humidity sensor, an illumination sensor or the like can be included as the sensor 804.
  • Sensor data detected by the sensor 804 is sent to the CPU 801. In this way, the CPU 801 can know the state of the transmission terminal 100 (present position, inclination, acceleration, direction, temperature, humidity, illumination or the like).
  • the input apparatus 808 includes an input section, such as a mouse, a keyboard, a touch panel, buttons, a microphone, switches or leavers, for a user to input information, and an input control circuit which generates an input signal based on an input by the user, and outputs the input signal to the CPU 801.
  • an input section such as a mouse, a keyboard, a touch panel, buttons, a microphone, switches or leavers, for a user to input information
  • an input control circuit which generates an input signal based on an input by the user, and outputs the input signal to the CPU 801.
  • the output apparatus 810 includes, for example, a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp.
  • the output apparatus 810 includes an audio output apparatus such as a speaker or headphones.
  • the display device displays a captured image, a generated image or the like.
  • the audio output apparatus converts audio data to sounds and outputs the sounds.
  • the storage apparatus 811 is an apparatus for data storage constituted as an example of a storage section of the transmission terminal 100.
  • the storage apparatus 811 may include a storage medium, a recording apparatus which records data to the storage medium, a reading apparatus which reads data from the storage medium, and an erasure apparatus which erases data recorded in the storage medium.
  • This storage apparatus 811 stores programs executed by the CPU 801 and various types of data.
  • the drive 812 is a reader/writer for the storage medium, and is built into the transmission terminal 100 or is externally attached.
  • the drive 812 reads information recorded on a removable storage medium, such as a mounted magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 803. Further, the drive 812 can write information to the removable storage medium.
  • the imaging apparatus 813 includes an imaging optical system such as an imaging lens which condenses light, a zoom lens or the like, and a signal conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).
  • the imaging optical system forms an image of a photographic subject on a signal conversion section by condensing light emitted from the photographic subject, and the signal conversion element converts the formed image of the photographic subject into electrical image signals.
  • the communication apparatus 815 is, for example, a communication interface constituted by a communication device or the like for connecting to a network. Further, the communication apparatus 815 may be a wired communication apparatus which communicates by wires, even if the communication apparatus 815 is a communication apparatus adaptive to wireless LAN (Local Area Network) or LTE (Long Term Evolution). For example, it is possible for the communication apparatus 815 to communicate with another apparatus via a network.
  • LAN Local Area Network
  • LTE Long Term Evolution
  • FIG. 21 is a figure which shows a hardware configuration example of the server apparatus 400 according to an embodiment of the present disclosure.
  • the hardware configuration example shown in FIG. 21 merely shows one example of a hardware configuration of the server apparatus 400. Therefore, the hardware configuration of the server apparatus 400 is not limited to the example shown in FIG. 21.
  • the server apparatus 400 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a storage apparatus 911, a drive 912, and a communication apparatus 915.
  • CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the CPU 901 functions as a calculation processing apparatus and a control apparatus, and controls all the operations within the server apparatus 400 in accordance with various programs. Further, the CPU 901 may be a microprocessor.
  • the ROM 902 stores programs, calculation parameters or the like which are used by the CPU 901.
  • the RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters which arbitrarily change in this execution, or the like. These sections are mutually connected by a host bus constituted from a CPU bus or the like.
  • the storage apparatus 911 is an apparatus for data storage constituted as an example of a storage section of the server apparatus 400.
  • the storage apparatus 911 may include a storage medium, a recording apparatus which records data to the storage medium, a reading apparatus which reads data from the storage medium, and an erasure apparatus which erases data recorded in the storage medium.
  • This storage apparatus 911 stores programs executed by the CPU 901 and various types of data.
  • the drive 912 is a reader/writer for the storage medium, and is built into the server apparatus 400 or is externally attached.
  • the drive 912 reads information recorded on a removable storage medium, such as a mounted magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. Further, the drive 912 can write information to the removable storage medium.
  • the communication apparatus 915 is, for example, a communication interface constituted by a communication device or the like for connecting to a network. Further, the communication apparatus 915 may be a wired communication apparatus which communicates by wires, even if the communication apparatus 915 is a communication apparatus adaptive to wireless LAN (Local Area Network) or LTE (Long Term Evolution). For example, it is possible for the communication apparatus 915 to communicate with another apparatus via a network.
  • LAN Local Area Network
  • LTE Long Term Evolution
  • a control apparatus 300 which includes an information acquisition section 311 which acquires information of a display image displayed by one terminal out of a transmission terminal 100 and a reception terminal 200, and information of a captured image captured by the other terminal, a comparison section 312 which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section 313 which controls whether or not data is transmitted from the transmission terminal 100 to the reception terminal 200 in accordance with the comparison result.
  • a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described transmission terminal 100 can be created.
  • a computer-readable storage medium, on which this program is recorded can also be provided.
  • a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described reception terminal 200 can be created.
  • a computer-readable storage medium, on which this program is recorded can also be provided.
  • a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described control apparatus 300 can be created.
  • a computer-readable storage medium, on which this program is recorded can also be provided.
  • a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described server apparatus 400 can be created.
  • a control apparatus including: an information acquisition section which acquires information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal; a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image; and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
  • the control apparatus according to (1) wherein the data transmitted from the transmission terminal to the reception terminal includes at least a video image.
  • the video image transmitted from the transmission terminal to the reception terminal includes at least a video image displayed by the transmission terminal.
  • the control apparatus according to any one of (1) to (7), wherein the information of the display image includes a feature amount extracted from the display image, and the information of the captured image includes a feature amount extracted from the captured image.
  • the information of the display image includes a part or all of the display image, and the information of the captured image includes a part or all of the captured image.
  • the information acquisition section acquires additional information from the transmission terminal, and acquires additional information from the reception terminal, and wherein the comparison section further compares the additional information acquired from the transmission terminal and the additional information acquired from the reception terminal.
  • control apparatus (11) The control apparatus according to any one of (1) to (10), wherein, in a case where a difference between a time when the display image is acquired and a time when the captured image is acquired is within a prescribed range, the comparison section compares the information of the display image and the information of the captured image. (12) The control apparatus according to any one of (1) to (11), wherein the control apparatus is incorporated into the transmission terminal. (13) The control apparatus according to any one of (1) to (11), wherein the control apparatus is incorporated into the reception terminal. (14) The control apparatus according to any one of (1) to (11), wherein the control apparatus is incorporated into a server apparatus different from the transmission terminal and the reception terminal.
  • a control method including: acquiring information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal; obtaining a comparison result by comparing the information of the display image and the information of the captured image; and controlling whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
  • a transmission terminal including: a communication control section which causes a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
  • a transmission method including: causing a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
  • a reception terminal including: a communication control section which causes a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
  • a display control section which causes a video image to be displayed on a display section, the video image being based on the data received from the transmission terminal.
  • a reception method including: causing a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
  • a control system including: a control apparatus; a transmission terminal; and a reception terminal, wherein the control apparatus includes an information acquisition section which acquires information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result, wherein the transmission terminal includes a communication control section which causes a communication section to perform data communication to the reception terminal, in a case where it is judged that the comparison result shows matching or a similarity, and wherein the reception terminal includes a communication control section which causes a communication section to receive data from the transmission terminal, in a case where it is judged that the comparison result shows matching or a similarity.
  • a control apparatus including: a circuitry configured to initiate an acquisition of information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal; obtain a comparison result by comparing the information of the display image and the information of the captured image; and control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
  • the data transmitted from the transmission terminal to the reception terminal includes at least a video image.
  • the video image transmitted from the transmission terminal to the reception terminal corresponds to a video image displayed by the transmission terminal.
  • the control apparatus according to any one of (29) to (31), wherein the data transmitted from the transmission terminal to the reception terminal includes at least an application.
  • the control apparatus according to any one of (29) to (32), wherein the application transmitted from the transmission terminal to the reception terminal corresponds to an application that is being executed by the transmission terminal.
  • the control apparatus according to any one of (29) to (33), wherein the data transmitted from the transmission terminal to the reception terminal includes at least information regarding an application execution state within the transmission terminal and a data file generated by an application execution.
  • a control method including: acquiring information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal; obtaining a comparison result by comparing the information of the display image and the information of the captured image; and controlling whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
  • a transmission terminal including: a circuitry configured to initiate a transmission of data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  • a transmission method including: transmitting data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  • a reception terminal including: a circuitry configured to initiate a reception of data sent from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the reception terminal and the transmission terminal, and information of a captured image captured by the other one of the reception terminal and the transmission terminal.
  • the circuitry is further configured to initiate a displaying of a video image, the video image being based on the data received from the transmission terminal.
  • the data received from the transmission terminal includes at least a video image, an information regarding an application execution state, and a data file generated by an application execution, and wherein, in a case where a distance to the transmission terminal becomes greater than a prescribed distance, the circuitry initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
  • the reception terminal according to any one of (50) to (53), wherein the data received from the transmission terminal includes at least a video image, an application, an information regarding an application execution state, and a data file generated by an application execution, and wherein the circuitry further initiates a displaying of an execution result of the application while displaying the video image, and when a prescribed timing is reached, initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
  • a reception method including: receiving data from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  • a control system including: a control apparatus; a transmission terminal; and a reception terminal, wherein the control apparatus includes a circuitry configured to initiate an acquisition of information of a display image displayed by one of the transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal, obtain a comparison result by comparing the information of the display image and the information of the captured image, and control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result, wherein the transmission terminal includes a circuitry configured to initiate a transmission of data to the reception terminal, in a case when a judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image, and wherein the reception terminal includes a circuitry configured to initiate a reception of the data sent from the transmission terminal, in a case when the judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image.
  • control system 100 transmission terminal 110 control section 111 display control section 112 captured image acquisition section 113 communication control section 120 input section 130 imaging section 140 detection section 150 storage section 160 communication section 170 display section 200 reception terminal 210 control section 211 display control section 212 captured image acquisition section 213 communication control section 220 input section 230 imaging section 240 detection section 250 storage section 260 communication section 270 display section 300 control apparatus 311 information acquisition section 312 comparison section 313 transmission control section 400 server apparatus 410 control section 450 storage section 460 communication section

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

There is provided a control apparatus including an information acquisition section which acquires information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.

Description

CONTROL APPARATUS, CONTROL METHOD, TRANSMISSION TERMINAL, TRANSMISSION METHOD, RECEPTION TERMINAL, RECEPTION METHOD, AND CONTROL SYSTEM CROSS REFERENCE TO RELATED APPLICATIONS
This application claims the benefit of Japanese Priority Patent Application JP 2013-160132 filed August 1, 2013, the entire contents of which are incorporated herein by reference.
The present disclosure relates to a control apparatus, a control method, a transmission terminal, a transmission method, a reception terminal, a reception method, and a control system.
In recent years, there has been an increase in the chance that a user will sees images at various locations such as a station or a store. The types of images which the user sees are sometimes images displayed by a display device such as digital signage, and are sometimes images which are printed on paper for advertising. In the case where the user discovers an image of interest at some location, there will be cases which can be considered in which the user stores data related to this image in a portable terminal of the user himself or herself, and wants to browse the data displayed by this terminal.
For example, in the case where a two-dimensional bar code is attached to an image, when the user moves the terminal so as to fit the two-dimensional bar code within an imaging range, and takes a photograph, it is possible for the terminal to recognize the two-dimensional bar code from the captured image and to receive data corresponding to the two-dimensional bar code. Various technologies have been disclosed as technologies related to the recognition of a two-dimensional bar code (for example, refer to PTL 1).
JP 2000-082108A
Summary
However, in the case where a two-dimensional bar code is recognized from a captured image, time may be necessary in order to recognize the two-dimensional bar code. Further, time may be necessary in order to specify data corresponding to the two-dimensional bar code. Accordingly, it is desirable for technology to be implemented capable of reducing the time which may be necessary for storing desired data in a terminal.
According to an embodiment of the present disclosure, there is provided a control apparatus including an information acquisition section which acquires information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
According to an embodiment of the present disclosure, there is provided a control method including acquiring information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal, obtaining a comparison result by comparing the information of the display image and the information of the captured image, and controlling whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
According to an embodiment of the present disclosure, there is provided a transmission terminal including a communication control section which causes a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
According to an embodiment of the present disclosure, there is provided a transmission method including causing a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
According to an embodiment of the present disclosure, there is provided a reception terminal including a communication control section which causes a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
According to an embodiment of the present disclosure, there is provided a reception method including causing a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
According to an embodiment of the present disclosure, there is provided a control system including a control apparatus, a transmission terminal, and a reception terminal. The control apparatus includes an information acquisition section which acquires information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal, a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result. The transmission terminal includes a communication control section which causes a communication section to perform data communication to the reception terminal, in a case where it is judged that the comparison result shows matching or a similarity. The reception terminal includes a communication control section which causes a communication section to receive data from the transmission terminal, in a case where it is judged that the comparison result shows matching or a similarity.
According to one or more embodiments of the present disclosure such as described above, it is possible to provide technology capable of reducing the time which may be necessary for storing desired data in a terminal.
FIG. 1 is a figure for describing a functional outline of a general control system. FIG. 2 is a sequence diagram which shows an operation example (example in which a transmission terminal selects a connection partner) of a general control system. FIG. 3 is a sequence diagram which shows an operation example (example in which a reception terminal selects a connection partner) of a general control system. FIG. 4 is a figure for describing a functional outline of a control system according to a first embodiment of the present disclosure. FIG. 5 is a figure which shows a functional configuration example of the transmission terminal according to the first embodiment of the present disclosure. FIG. 6 is a figure which shows a functional configuration example of the reception terminal according to the first embodiment of the present disclosure. FIG. 7 is a sequence diagram which shows an operation example (example in which the transmission terminal selects a connection partner) of the control system according to the first embodiment of the present disclosure. FIG. 8 is a sequence diagram which shows an operation example (example in which the reception terminal selects a connection partner) of the control system according to the first embodiment of the present disclosure. FIG. 9 is a sequence diagram which shows an operation example (example in which the transmission terminal performs imaging) of the control system according to the first embodiment of the present disclosure. FIG. 10 is a sequence diagram which shows an operation example (example in which a video image and an application are transmitted in parallel) of the control system according to the first embodiment of the present disclosure. FIG. 11 is a sequence diagram which shows an operation example (example in which a transmission line of data is switched) of the control system according to the first embodiment of the present disclosure. FIG. 12 is a figure which shows a functional configuration example of the transmission terminal according to a second embodiment of the present disclosure. FIG. 13 is a figure which shows a functional configuration example of the reception terminal according to the second embodiment of the present disclosure. FIG. 14 is a sequence diagram which shows an operation example (example in which the transmission terminal selects a connection partner) of the control system according to the second embodiment of the present disclosure. FIG. 15 is a sequence diagram which shows an operation example (example in which the reception terminal selects a connection partner) of the control system according to the second embodiment of the present disclosure. FIG. 16 is a diagram which shows a functional configuration example of the transmission terminal according to a third embodiment of the present disclosure. FIG. 17 is a figure which shows a functional configuration example of the reception terminal according to the third embodiment of the present disclosure. FIG. 18 is a figure which shows a functional configuration example of a server apparatus according to the third embodiment of the present disclosure. FIG. 19 is a sequence diagram which shows an operation example of the control system according to the third embodiment of the present disclosure. FIG. 20 is a figure which shows a hardware configuration example of each of the transmission terminal and the reception terminal according to an embodiment of the present disclosure. FIG. 21 is a figure which shows a hardware configuration example of the server apparatus according to an embodiment of the present disclosure.
Hereinafter, embodiments of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
Further, in this specification and the appended drawings, there are cases where a plurality of structural elements having substantially the same functional structure are distinguished by attaching different letters of the alphabet after the same reference numerals. However, in the case where it is not necessary to particularly distinguish each of the plurality of structural elements having substantially the same functional structure, only the same reference numerals will be attached.
Further, a description of this "Description of Embodiments" will be made according to the order of items shown below.
0. General Technology
1. The First Embodiment
1-1. Functional outline of the control system
1-2. Functional configuration example of the transmission terminal
1-3. Functional configuration example of the reception terminal
1-4. Operation examples of the control system
2. The Second Embodiment
2-1. Functional configuration example of the transmission terminal
2-2. Functional configuration example of the reception terminal
2-3. Operation examples of the control system
3. The Third Embodiment
3-1. Functional configuration example of the transmission terminal
3-2. Functional configuration example of the reception terminal
3-3. Functional configuration example of the server apparatus
3-4. Operation example of the control system
4. Hardware Configuration Examples
5. Conclusion
<<0. General Technology>>
First, general technology will be described prior to description of embodiments of the present disclosure. FIG. 1 is a figure for describing a functional outline of a general control system 90. As shown in FIG. 1, the control system 90 includes a transmission terminal 700 and a reception terminal 800. Applications are executed in the transmission terminal 700, and a video image Im1 is displayed as an execution result of the application. Here, it will be assumed that a case is considered in which a user wants to display the video image Im1 on the reception terminal 800 at the time when viewing the video image Im1.
In such a case, when the user brings the reception terminal 800 close to the transmission terminal 700, a connection process between the transmission terminal 700 and the reception terminal 800 starts. When the connection process between the transmission terminal 700 and the reception terminal 800 is completed, a window D93, which indicates that the video image Im1 will be displayed on the transmission terminal 700, is displayed on the reception terminal 800. Afterwards, the video image Im1 is transmitted from the transmission terminal 700 to the reception terminal 800, and the reception terminal 800 displays the video image Im1.
To continue, the general technology will be additionally described while referring to sequence diagrams. Note that, an example will be shown in which the control system 90 operates in accordance with Wi-Fi Direct (registered trademark), as an example, in the following sequence charts.
FIG. 2 is a sequence diagram which shows an operation example of the general control system 90. In particular, the example shown in FIG. 2 corresponds to an example in which the transmission terminal 700 selects a connection partner. First, each of the transmission terminal 700 and the reception terminal 800 transmit a detection signal for detecting a terminal in the surroundings (S901). In the case where the reception terminal 800 which receives this detection signal is present, the transmission terminal 700 displays a window D91 which inquires whether or not to transmit a connection request to this reception terminal 800 (S902).
When an operation is accepted from a user which indicates that a connection request is to be transmitted to the reception terminal 800 (S903), the transmission terminal 700 transmits a connection request to the reception terminal 800 (S904). When the connection request is received from the transmission terminal 700, the reception terminal 800 displays a window D92 which inquires whether or not to accept the connection request from the transmission terminal 700 (S905). When an operation is accepted from the user which indicates that the connection request is to be accepted (S906), the reception terminal 800 transmits a connection response to the transmission terminal 700 (S907), and the transmission terminal 700 transmits a confirmation message to the reception terminal 800 (S908).
To continue, when an authentication, WPS (registered trademark) and association are performed between the transmission terminal 700 and the reception terminal 800 (S909, S910 and S911), and an RTP (Real-time Transport Protocol) session is established in an RTSP (Real Time Streaming Protocol) (S912), the reception terminal 800 displays a window D93 which indicates that the video image Im1 of the transmission terminal 700 will be displayed (S913). Afterwards, the transmission terminal 700 transmits the video image Im1 to the reception terminal 800 by the RTP (S914), and when the video image Im1 is received from the transmission terminal 700, the reception terminal 800 displays the video image Im1 (S915).
FIG. 3 is a sequence diagram which shows an operation example of the general control system 90. In particular, the example shown in FIG. 3 corresponds to an example in which the reception terminal 800 selects a connection partner. First, each of the transmission terminal 700 and the reception terminal 800 transmit a detection signal for detecting a terminal in the surroundings (S901). In the case where the transmission terminal 700 which receives this detection signal is present, the reception terminal 800 displays a window D91 which inquires whether or not to transmit a connection request to this transmission terminal 700 (S902).
When an operation is accepted from a user which indicates that a connection request is to be transmitted to the transmission terminal 700 (S903), the reception terminal 800 transmits a connection request to the transmission terminal 700 (S904). When the connection request is received from the reception terminal 800, the transmission terminal 700 displays a window D92 which inquires whether or not to accept the connection request from the reception terminal 800 (S905). When an operation is accepted from the user which indicates that the connection request is to be accepted (S906), the transmission terminal 700 transmits a connection response to the reception terminal 800 (S907), and the reception terminal 800 transmits a confirmation message to the transmission terminal 700 (S908).
To continue, when an authentication, WPS (registered trademark) and association are performed between the transmission terminal 700 and the reception terminal 800 (S909, S910 and S911), and an RTP (Real-time Transport Protocol) session is established in an RTSP (Real Time Streaming Protocol) (S912), the reception terminal 800 displays a window D93 which indicates that the video image Im1 of the transmission terminal 700 will be displayed (S913). Afterwards, the transmission terminal 700 transmits the video image Im1 to the reception terminal 800 by the RTP (S914), and when the video image Im1 is received from the transmission terminal 700, the reception terminal 800 displays the video image Im1 (S915).
Heretofore, general technology has been described. In such general technology, since an operation is sought after from a user which indicates that a connection request is to be transmitted, there is the possibility that the operation will become complicated for the user. On the other hand, while the complexity of an operation provided to the user will be reduced if a connection request is transmitted without waiting for an operation from the user, there is the possibility that incorrect data transmission will be performed from the transmission terminal 700 to the reception terminal 800. In the present disclosure, technology is provided for reducing the possibility of incorrect data transmission being performed from the transmission terminal 700 to the reception terminal 800, while reducing the complexity of operations provided to the user.
In addition, in such general technology, a window D93 is displayed which indicates that a video image Im1 of the transmission terminal 700 will be displayed, and the video image Im1 is suddenly displayed subsequent to the window D93. A progress bar can also be displayed which shows the progress condition of the connection process while the connection process is being performed. However, it may be difficult for the user to intuitively understand what process is being executed, even if such a display is performed. In the present disclosure, technology is proposed in which the user intuitively and easily understands what process is being executed.
Further, a case will be assumed in which a two-dimensional bar code is attached to the video image Im1 displayed by the transmission terminal 700. In such a case, when the user moves the reception terminal 800 so as to fit the two-dimensional bar code within an imaging range, and takes a photograph, it is possible for the reception terminal 800 to recognize the two-dimensional bar code from the captured image and to receive the video image Im1 corresponding to the two-dimensional bar code. However, in the case where a two-dimensional bar code is recognized from a captured image, time may be necessary in order to recognize the two-dimensional bar code. Further, time may be necessary in order to specify data corresponding to the two-dimensional bar code. In the present disclosure, technology is proposed capable of reducing the time which may be necessary for storing desired data in the reception terminal 800.
<<1. The First Embodiment>>
First, a first embodiment of the present disclosure will be described. In the first embodiment of the present disclosure, a control apparatus 300, which controls data transmission from a transmission terminal 100 to a reception terminal 200, is incorporated into the reception terminal 200. However, the control apparatus 300 may not necessarily be incorporated into the reception terminal 200, such as will be described in the other embodiments.
<1-1. Functional outline of the control system>
First of all, a functional outline of a control system 10 according to the first embodiment of the present disclosure will be described. FIG. 4 is a figure for describing a functional outline of the control system 10 according to the first embodiment of the present disclosure. As shown in FIG. 4, the control system 10 includes a transmission terminal 100 and a reception terminal 200. An application is executed in the transmission terminal 100, and a video image Im1 is displayed as an execution result of the application. Here, it will be assumed that a case is considered in which a user wants to display the video image Im1 on the reception terminal 200 at the time when viewing the video image Im1.
In such a case, when the user moves the reception terminal 200 so that a part or all of the video image Im1 fits within an imaging range of the reception terminal 200, a captured video image Im0 is displayed by the reception terminal 200. Here, for example, in the case where a feature amount of an image displayed by the transmission terminal 100, and a feature amount of an image captured by the reception terminal 200, are similar or match each other, a connection process between the transmission terminal 100 and the reception terminal 200 may be started. Further, when the connection process between the transmission terminal 100 and the reception terminal 200 is completed, the transmission terminal 100 may transmit the video image Im1 to the reception terminal 200, and the reception terminal 200 may display the video image Im1.
The feature amounts extracted from the images are not particularly limited, and for example, may be histograms representing a distribution of colors of the images, or may be histograms representing a distribution of luminance. Further, the feature amounts extracted from the images may be object regions recognized from the images, or may be face regions recognized from the images.
Note that, as an example, the present embodiment will described a case in which the transmission terminal 100 and the reception terminal 200 are connected via a wireless LAN (Local Area Network), for example, and communication is capable of being performed between the transmission terminal 100 and the reception terminal 200 via the wireless LAN. However, communication between the transmission terminal 100 and the reception terminal 200 may be by wireless communication not via the wireless LAN (for example, infrared communication or the like), or may be by wired communication.
Further, while a case is shown in FIG. 4 in which the transmission terminal 100 is a television apparatus and the reception terminal 200 is a tablet terminal, the type of terminal for each of the transmission terminal 100 and the reception terminal 200 is not particularly limited. For example, the type of terminal for each of the transmission terminal 100 and the reception terminal 200 may be a video camera, may be a smart phone, or may be a PDA (Personal Digital Assistant). Or, the type of terminal for each of the transmission terminal 100 and the reception terminal 200 may be a PC (Personal Computer), may be a mobile phone, may be a portable music playback apparatus, may be a mobile video processing apparatus, or may be a portable game machine.
Heretofore, a functional outline of the control system 10 according to the first embodiment of the present disclosure has been described.
<1-2. Functional configuration example of the transmission terminal>
To continue, a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure will be described. FIG. 5 is a figure which shows a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure. As shown in FIG. 5, the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170.
For example, the control section 110 corresponds to a processor such as a CPU (Central Processing Unit). The control section 110 exhibits the various functions of the control section 110, by executing programs stored in the storage section 150 or another storage medium. The control section 110 has a display control section 111, a captured image acquisition section 112, and a communication control section 113. Each of these functional sections of the control section 110 will be described afterwards.
The input section 120 has a function which accepts an operation from a user. The input section 120 outputs the operation accepted from the user to the control section 110. The operation can be used for the execution of a program. Further, for example, the input section 120 can accept an operation from the user which starts the activation of a program. Further, for example, the input section 120 can accept an operation from the user which completes the execution of a program. While the input section 120 is incorporated into the transmission terminal 100 in the example shown in FIG. 5, the input section 120 may be present outside of the transmission terminal 100.
The imaging section 130 acquires a captured image by capturing an imaging range, and outputs the captured image to the control section 110. The imaging section 130 performs imaging by imaging magnification set in accordance with an operation input to the input section 120. While an adjustment of the imaging magnification can be implemented by a zoom function, this zoom function is not particularly limited, and may be an optical zoom function, or may be an electronic zoom function. Note that, while the imaging section 130 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the imaging section 130 may be constituted separately from the transmission terminal 100.
The detection section 140 detects prescribed sensor data, and outputs the detected sensor data to the control section 110. The detection section 140 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the present position of the transmission terminal 100) by using GPS signals received by the GPS antenna. Note that, the sensor data detected by the detection section 140 may be data other than GPS data. Further, while the detection section 140 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the detection section 140 may be constituted separately from the transmission terminal 100.
The storage section 150 stores programs for operating the control section 110, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 150 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 150 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the storage section 150 may be constituted separately from the transmission terminal 100.
The communication section 160 is capable of communicating with the reception terminal 200. The form of the communication by the communication section 160 is not particularly limited, and the communication by the communication section 160 may be wireless communication, or may be wired communication. Note that, while the communication section 160 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the communication section 160 may be constituted separately from the transmission terminal 100.
The display section 170 performs display of various types of information, in accordance with a control by the control section 110. For example, the display section 170 may include an LCD (Liquid Crystal Display), or an organic EL (Electroluminescence) display apparatus. Or, the display section 170 may include an audio output apparatus such as a speaker or headphones. Note that, while the display section 170 is integrated with the transmission terminal 100 in the example shown in FIG. 5, the display section 170 may be constituted separately from the transmission terminal 100.
In the case where it is judged that a comparison result shows matching or similarities between information of a display image displayed by one terminal out of the transmission terminal 100 and the reception terminal 200, and information of a captured image captured by the other terminal, the communication control section 113 causes the communication section 160 to perform data communication to the reception terminal 200. According to such a function of the communication control section 113, it becomes possible to reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, while reducing the complexity of operations provided to a user. The data transmitted to the reception terminal 200 is not particularly limited, and may be at least a video image, or may be at least an application.
The information of a display image and the information of a captured image are each not particularly limited. For example, the information of a display image may include a feature amount extracted from the display image, and the information of a captured image may include a feature amount extracted from the captured image. In such a case, while time may be necessary in order to extract a feature amount from the image, there is the possibility that the transmission of a feature amount will be more appropriate from the viewpoint of security than the transmission of the image itself prior to the completion of the connection process between the transmission terminal 100 and the reception terminal 200.
However, the information of the display image may include a part or all of the display image, and the information of the captured image may include a part or all of the captured image. Hereinafter, while a description will be mainly made for the case where a feature amount of a display image is used as the information of the display image, and a feature amount of a captured image is used as the information of the captured image, the information of the display image is not limited to a feature amount of the display image, and the information of the captured image is not limited to a feature amount of the captured image.
In the case where a video image is transmitted from the transmission terminal 100 to the reception terminal 200, the transmitted video image may be any type of video image, and may include at least a video image Im1 displayed by the transmission terminal 100. In such a case, it becomes possible to store this video image Im1 itself in the reception terminal 200, at the time when a user becomes interested in the video image Im1 displayed by the transmission terminal 100.
Further, in the case where an application is transmitted from the transmission terminal 100 to the reception terminal 200, the transmitted application may be any type of application, and may include at least an application executed by the transmission terminal 100. In such a case, it becomes possible to store this application itself in the reception terminal 200, at the time when a user becomes interested in the application executed by the transmission terminal 100.
Additionally, the display control section 111 may have a function similar to that of the display control section 211. The control apparatus 300 includes an information acquisition section 311, a comparison section 312, and a transmission control section 313. The information acquisition section 311 acquires a feature amount of a display image displayed by one terminal out of the transmission terminal 100 and the reception terminal 200, and a feature amount of a captured image captured by the other terminal. Also, the comparison section 312 obtains a comparison result by comparing the feature amount of the display image and the feature amount of the captured image.
Further, the transmission control section 313 controls whether or not data is transmitted from the transmission terminal 100 to the reception terminal 200 in accordance with the comparison result. For example, in the case where the comparison result shows matching or similarities between the feature amount of the display image and the feature amount of the captured image, the transmission control section 313 may allow data to be transmitted from the transmission terminal 100 to the reception terminal 200.
Heretofore, a functional configuration example of the transmission terminal 100 according to the first embodiment of the present disclosure has been described.
<1-3. Functional configuration example of the reception terminal>
To continue, a functional configuration example of the reception terminal 200 according to the first embodiment of the present disclosure will be described. FIG. 6 is a figure which shows a functional configuration example of the reception terminal 200 according to the first embodiment of the present disclosure. As shown in FIG. 6, the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270.
For example, the control section 210 corresponds to a processor such as a CPU (Central Processing Unit). The control section 210 exhibits the various functions of the control section 210, by executing programs stored in the storage section 250 or another storage medium. The control section 210 has a display control section 211, a captured image acquisition section 212, and a communication control section 213. Each of these functional sections of the control section 210 will be described afterwards.
The input section 220 has a function which accepts an operation from a user. The input section 220 outputs the operation accepted from the user to the control section 210. The operation can be used for the execution of a program. Further, for example, the input section 220 can accept an operation from the user which starts the activation of a program. Further, for example, the input section 220 can accept an operation from the user which completes the execution of a program. While the input section 220 is incorporated into the reception terminal 200 in the example shown in FIG. 6, the input section 220 may be present outside of the reception terminal 200.
The imaging section 230 acquires a captured image by capturing an imaging range, and outputs the captured image to the control section 210. The imaging section 230 performs imaging by imaging magnification set in accordance with an operation input to the input section 220. While an adjustment of the imaging magnification can be implemented by a zoom function, this zoom function is not particularly limited, and may be an optical zoom function, or may be an electronic zoom function. Note that, while the imaging section 230 is integrated with the reception terminal 200 in the example shown in FIG. 6, the imaging section 230 may be constituted separately from the reception terminal 200.
The detection section 240 detects prescribed sensor data, and outputs the detected sensor data to the control section 210. The detection section 240 has a GPS (Global Positioning System) antenna, and detects GPS data (latitude and longitude of the present position of the reception terminal 200) by using GPS signals received by the GPS antenna. Note that, the sensor data detected by the detection section 240 may be data other than GPS data. Further, while the detection section 240 is integrated with the reception terminal 200 in the example shown in FIG. 6, the detection section 240 may be constituted separately from the reception terminal 200.
The storage section 250 stores programs for operating the control section 210, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 250 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 250 is integrated with the reception terminal 200 in the example shown in FIG. 6, the storage section 250 may be constituted separately from the reception terminal 200.
The communication section 260 is capable of communicating with the transmission terminal 100. The form of the communication by the communication section 260 is not particularly limited, and the communication by the communication section 260 may be wireless communication, or may be wired communication. Note that, while the communication section 260 is integrated with the reception terminal 200 in the example shown in FIG. 6, the communication section 260 may be constituted separately from the reception terminal 200.
The display section 270 performs display of various types of information, in accordance with a control by the control section 210. For example, the display section 270 may include an LCD (Liquid Crystal Display), or an organic EL (Electroluminescence) display apparatus. Or, the display section 270 may include an audio output apparatus such as a speaker or headphones. Note that, while the display section 270 is integrated with the reception terminal 200 in the example shown in FIG. 6, the display section 270 may be constituted separately from the reception terminal 200.
In the case where it is judged that a comparison result shows matching or similarities between a feature amount of a display image displayed by one terminal out of the reception terminal 200 and the transmission terminal 100, and a feature amount of a captured image captured by the other terminal, the communication control section 213 causes the communication section 260 to receive data from the transmission terminal 100. According to such a function of the communication control section 213, it becomes possible to reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, while reducing the complexity of operations provided to the user. The display control section 211 displays a video image on the display section 270, based on the data received from the transmission terminal 100.
Heretofore, a functional configuration example of the reception terminal 200 according to the first embodiment of the present disclosure has been described.
<1-4. Operation examples of the control system>
To continue, an operation example of the control system 10 according to the first embodiment of the present disclosure will be described. FIG. 7 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 7 corresponds to an example in which the transmission terminal 100 selects a connection partner. Further, the example shown in FIG. 7 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
First, the communication control section 113 in the transmission terminal 100 transmits a detection signal for detecting a terminal in the surroundings, and the communication control section 213 in the reception terminal 200 transmits a detection signal for detecting a terminal in the surroundings (S101). The communication control section 213 controls the communication section 260 so as to notify the terminal in the surroundings that connection to a camera is possible (S102). Note that, it may not be necessary to notify that connection to a camera is possible.
To continue, the display control section 111 displays an image on the display section 170 (S103), and when a feature amount of the display image is extracted (S104), the communication control section 113 controls the communication section 160 so that the feature amount of the display image is transmitted to the terminal in the surroundings (S108). On the other hand, an image is captured by the imaging section 230 (S105), a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), and when the feature amount of the display image and the feature amount of the captured image are acquired by the information acquisition section 311, the comparison section 312 compares both feature amounts (S110).
To continue, in the case where the reception terminal 200 which receives the detection signal is present, the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109). In the case where it is judged that a comparison result shows matching or similarities when the communication control section 213 controls the communication section 260 so that the connection request is received from the transmission terminal 100, the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111), and the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
To continue, when an authentication, WPS (registered trademark) and association are performed between the transmission terminal 100 and the reception terminal 200 (S113, S114 and S115), and an RTP (Real-time Transport Protocol) session is established in an RTSP (Real Time Streaming Protocol) (S116), the communication control section 113 controls the communication section 160 so that a video image Im1 is transmitted to the reception terminal 200 by the RTP (S117), and when the communication control section 213 controls the communication section 260 so that the video image Im1 is received from the transmission terminal 100, the display control section 211 displays the video image Im1 on the display section 270.
While an image is captured by the imaging section 230 in the above described example, the display control section 211 may display a video image Im0 captured by the imaging section 230 on the display section 270, such as shown in FIG. 7. In such a case, when data is received from the transmission terminal 100, the display control section 211 performs a transition of the display by the display section 270 from the video image Im0 captured by the imaging section 230 to the video image Im1 based on data received from the transmission terminal 100.
In the above described general technology, since the video image Im1 is suddenly displayed based on data received from the transmission terminal 100, it may be difficult for the user to intuitively understand what process is being executed. Compared to such general technology, if an image displayed by the transmission terminal 100 is captured and displayed on the reception terminal 200, it will be easier for the user to intuitively understand that data is being transmitted from the transmission terminal 100 to the reception terminal 200.
The display image displayed by the transmission terminal 100 and the captured image captured by the reception terminal 200 may be still images or may be moving images. Here, it will be assumed that time may be necessary to some extent from the display image being displayed up until the captured image is captured. Therefore, in the case where the display image and the captured image are moving images, and in the case where a difference between the time when the display image is acquired and the time when the captured image is acquired is within a prescribed range, the comparison section 312 may compare a feature amount of the display image and a feature amount of the captured image.
Further, while an application may be executed from the beginning in the reception terminal 200, in the case where the application has already been partway executed in the transmission terminal 100, the application may not be executed from the beginning in the reception terminal 200. Accordingly, the data transmitted to the reception terminal 200 may include at least an application execution state in the transmission terminal 100 and a file generated by an application execution. In such a case, it becomes possible for an application to be executed in the reception terminal 200 from a continuation of an execution of the application in the transmission terminal 100 based on the application execution state and the file. Note that, at the time of application execution, the application execution state is stored in the RAM 803, and the file generated by the application execution is stored in the storage apparatus 811.
The display by the reception terminal 200 may be changed according to whether or not communication between the transmission terminal 100 and the reception terminal 200 is possible via the wireless LAN. For example, in the case where the data received from the transmission terminal 100 includes at least a video image, an application execution state and a file generated by an application execution, the display control section 211 switches the display by the display section 270 from the video image to an execution result of an application based on the application result state and the file, in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance. According to such a configuration, it becomes possible to resume an image display in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
FIG. 8 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 8 corresponds to an example in which the reception terminal 200 selects a connection partner. Further, the example shown in FIG. 8 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
S101 to S108 and S110 shown in FIG. 8 can be executed the same as S101 to S108 and S110 shown in FIG. 7. Further, S113 to S117 shown in FIG. 8 can be executed the same as S113 to S117 shown in FIG. 7. Therefore, here, S109, S111 and S112 shown in FIG. 8 will be mainly described.
When a comparison of both feature amounts by the comparison section 312 ends, in the case where the transmission terminal 100 which receives a detection signal is present, and in the case where it is judged that the comparison result of the feature amounts shows matching or similarities, the transmission control section 313 controls the communication section 260 so that a connection request is transmitted to this transmission terminal 100 (S109). When the communication control section 113 controls the communication section 160 so that the connection request is received from the reception terminal 200, the communication control section 113 controls the communication section 160 so that a connection response is transmitted to the reception terminal 200 (S111), and the communication control section 213 controls the communication section 260 so that a confirmation message is transmitted to the transmission terminal 100 (S112).
FIG. 9 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 9 corresponds to an example in which the transmission terminal 100 captures an image, and the reception terminal 200 displays an image. Further, the example shown in FIG. 9 corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
S101 and S102 shown in FIG. 9 can be executed the same as S101 and S102 shown in FIG. 7 or FIG. 8. Further, S108 to S117 shown in FIG. 9 can be executed the same as S108 to S117 shown in FIG. 7 or FIG. 8. Therefore, here, S103 to S107 shown in FIG. 9 will be mainly described.
In the example shown in FIG. 9, the display control section 211 displays an image on the display section 270 (S103), and extracts a feature amount of the display image (S104). On the other hand, an image is captured by the imaging section 130 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 112 (S107), the communication control section 113 controls the communication section 160 so that the feature amount of the captured image is transmitted to a terminal in the surroundings (S108).
While the image is displayed by the display section 270 in the above described example, the display control section 211 may display a prescribed image Im2 on the display section 270, such as shown in FIG. 9. The image Im2 can be any type of image, and may be an image obtained by capturing some terminal, such as shown in FIG. 9. In such a case, when data is received from the transmission terminal 100, the display control section 211 may perform a transition of the display by the display section 270 from the image Im2 to a video image Im1 based on data received from the transmission terminal 100.
FIG. 10 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 10 corresponds to an example in which a video image and an application are transmitted in parallel. In the example shown in FIG. 10, S101 to S117 shown in FIG. 7 to FIG. 9 have already been executed, and the operations which can be additionally performed after this will be mainly described.
While a video image can be transmitted from the transmission terminal 100 to the reception terminal 200 (S117, S122), an application, an application execution state and a file generated by an application execution may be transmitted from the transmission terminal 100 to the reception terminal 200 in parallel with the video image. In such a case, a distance between the transmission terminal 100 and the reception terminal 200 is determined (S123), and in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance, the display control section 211 may perform a transition of the display by the display section 270 from the video image to an execution result of the application based on the application execution state and the file (S124).
In this example, in the case where the data received from the transmission terminal 100 includes at least a video image, an application, an application execution state and a file generated by an application execution, the display control section 211 may perform preparations for displaying an execution result of the application based on the application execution state and the file while displaying the video image on the display section 270, and may switch the display by the display section 270 from the video image to the execution result of the application at the time when a prescribed timing is reached. According to such a configuration, it becomes possible for video image display to be smoothly continued in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
FIG. 11 is a sequence diagram which shows an operation example of the control system 10 according to the first embodiment of the present disclosure. In particular, the example shown in FIG. 11 corresponds to an example in which a transmission line of data is switched. In the example shown in FIG. 11, S101 to S117 shown in FIG. 7 to FIG. 9 have already been executed, and the operations which can be additionally performed after this will be mainly described.
A case will be assumed in which communication via the wireless LAN is not possible while data is transmitted from the transmission terminal 100 to the reception terminal 200 via the wireless LAN. Accordingly, a distance between the transmission terminal 100 and the reception terminal 200 is determined (S131), and in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance, the display control section 211 may transmit a transmission line switching instruction to the transmission terminal 100 (S132). Further, when the transmission terminal 100 receives the transmission line switching instruction, the transmission terminal 100 may switch the transmission line so as to transmit data via a public wireless network (S133, S134).
In this example, in the case where the distance between the transmission terminal 100 and the reception terminal 200 becomes greater than a prescribed distance, the communication control section 113 may switch the transmission line of data transmitted by the communication section 160 from the wireless LAN to a public wireless network. According to such a configuration, it is possible to continue to transmit data from the transmission terminal 100 to the reception terminal 200, even in the case where communication via the wireless LAN is not possible. Note that, while the video image can be transmitted from the transmission terminal 100 to the reception terminal 200, an application, an application execution state and a file generated by an application result may be transmitted from the transmission terminal 100 to the reception terminal 200 in parallel with the transmission of the video image. The display control section 211 may perform preparations for displaying an execution result of the application based on the application execution state and the file while displaying the video image on the display section 270, and may switch the display by the display section 270 from the video image to the execution result of the application at the time when a prescribed timing is reached. According to such a configuration, it becomes possible for video image display to be smoothly continued in the reception terminal 200, even in the case where communication via the wireless LAN is not possible.
Heretofore, operation examples of the control system 10 according to the first embodiment of the present disclosure have been described.
<<2. The Second Embodiment>>
To continue, a second embodiment of the present disclosure will be described. In the second embodiment of the present disclosure, the control apparatus 300, which controls data transmission from the transmission terminal 100 to the reception terminal 200, is incorporated into the transmission terminal 100. However, as described in the other embodiments, the control apparatus 300 may not necessarily be incorporated into the transmission terminal 100. Hereinafter, a description for elements in the second embodiment which are similar to those of the first embodiment will be omitted, and a description will be mainly made for elements in the second embodiment different to those of the first embodiment.
<2-1. Functional configuration example of the transmission terminal>
First, a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure will be described. FIG. 12 is a figure which shows a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure. As shown in FIG. 12, the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170. In addition, the transmission terminal 100 includes the control apparatus 300.
Heretofore, a functional configuration example of the transmission terminal 100 according to the second embodiment of the present disclosure has been described.
<2-2. Functional configuration example of the reception terminal>
To continue, a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure will be described. FIG. 13 is a figure which shows a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure. As shown in FIG. 13, the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270. As described above, in the second embodiment of the present disclosure, the transmission terminal 100 includes the control apparatus 300 instead of the reception terminal 200.
Heretofore, a functional configuration example of the reception terminal 200 according to the second embodiment of the present disclosure has been described.
<2-3. Operation examples of the control system>
To continue, an operation example of the control system 10 according to the second embodiment of the present disclosure will be described. FIG. 14 is a sequence diagram which shows an operation example of the control system 10 according to the second embodiment of the present disclosure. In particular, the example shown in FIG. 14 corresponds to an example in which the transmission terminal 100 selects a connection partner. Further, the example shown in FIG. 14 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
S101 to S107 shown in FIG. 14 can be executed the same as S101 to S107 shown in FIG. 8. Further, S113 to S117 shown in FIG. 14 can be executed the same as S113 to S117 shown in FIG. 8. Therefore, here, S108 to S112 shown in FIG. 14 will be mainly described.
To continue, the display control section 111 displays an image on the display section 170 (S103), and extracts a feature amount of the display image (S104). On the other hand, an image is captured by the imaging section 230 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), the communication control section 213 controls the communication section 260 so that the feature amount of the captured image is transmitted to a terminal in the surroundings (S108). On the other hand, when the feature amount of the display image and the feature amount of the captured image are acquired by the information acquisition section 311, the comparison section 312 compares both feature amounts (S110).
When a comparison of both feature amounts by the comparison section 312 ends, in the case where the reception terminal 200 which receives a detection signal is present, and in the case where it is judged that the comparison result of the feature amounts shows matching or similarities, the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109). When the communication control section 213 controls the communication section 260 so that the connection request is received from the transmission terminal 100, the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111), and the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
FIG. 15 is a sequence diagram which shows an operation example of the control system 10 according to the second embodiment of the present disclosure. In particular, the example shown in FIG. 15 corresponds to an example in which the reception terminal 200 selects a connection partner. Further, the example shown in FIG. 15 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
S101 to S108 and S110 shown in FIG. 15 can be executed the same as S101 to S108 and S110 shown in FIG. 14. Further, S113 to S117 shown in FIG. 15 can be executed the same as S113 to S117 shown in FIG. 14. Therefore, here, S109, S111 and S112 shown in FIG. 15 will be mainly described.
In the case where the transmission terminal 100 which receives a detection signal is present, the transmission control section 313 controls the communication section 260 so that a connection request is transmitted to this transmission terminal 100 (S109). When the communication control section 113 controls the communication section 160 so that the connection request is received from the reception terminal 200, in the case where it is judged that a comparison result shows matching or similarities, the communication control section 113 controls the communication section 160 so that a connection response is transmitted to the reception terminal 200 (S111), and the communication control section 213 controls the communication section 260 so that a confirmation message is transmitted to the transmission terminal 100 (S112).
Heretofore, an operation example of the control system 10 according to the second embodiment of the present disclosure has been described.
<<3. The Third Embodiment>>
To continue, a third embodiment of the present disclosure will be described. In the third embodiment of the present disclosure, the control apparatus 300, which controls data transmission from the transmission terminal 100 to the reception terminal 200, is incorporated into a server apparatus 400 different to the transmission terminal 100 and the reception terminal 200. However, as described in the other embodiments, the control apparatus 300 may not necessarily be incorporated into the server apparatus 400. Hereinafter, a description for elements in the third embodiment which are similar to those of the other embodiments will be omitted, and a description will be mainly made for elements in the third embodiment different to those of the other embodiments.
<3-1. Functional configuration example of the transmission terminal>
First, a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure will be described. FIG. 16 is a figure which shows a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure. As shown in FIG. 16, the transmission terminal 100 includes a control section 110, an input section 120, an imaging section 130, a detection section 140, a storage section 150, a communication section 160, and a display section 170. As described above, in the third embodiment of the present disclosure, the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
Heretofore, a functional configuration example of the transmission terminal 100 according to the third embodiment of the present disclosure has been described.
<3-2. Functional configuration example of the reception terminal>
To continue, a functional configuration example of the reception terminal 200 according to the third embodiment of the present disclosure will be described. FIG. 17 is a figure which shows a functional configuration example of the reception terminal 200 according to the third embodiment of the present disclosure. As shown in FIG. 17, the reception terminal 200 includes a control section 210, an input section 220, an imaging section 230, a detection section 240, a storage section 250, a communication section 260, and a display section 270. As described above, in the third embodiment of the present disclosure, the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
Heretofore, a functional configuration example of the reception terminal 200 according to the third embodiment of the present disclosure has been described.
<3-3. Functional configuration example of the server apparatus>
To continue, a functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure will be described. FIG. 18 is a figure which shows a functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure. As shown in FIG. 18, the server apparatus 400 includes a control section 410, a storage section 450, and a communication section 460. As described above, in the third embodiment of the present disclosure, the server apparatus 400 includes the control apparatus 300 instead of the transmission terminal 100 or the reception terminal 200.
For example, the control section 410 corresponds to a processor such as a CPU (Central Processing Unit). The control section 410 exhibits the various functions of the control section 410, by executing programs stored in the storage section 450 or another storage medium.
The storage section 450 stores programs for operating the control section 410, by using a recording medium such as a semiconductor memory or a hard disk. Further, for example, the storage section 450 can store various types of data used by the programs (for example, various setting information, contents or the like). Note that, while the storage section 450 is integrated with the server apparatus 400 in the example shown in FIG. 18, the storage section 450 may be constituted separately from the server apparatus 400.
The communication section 460 is capable of communicating with the transmission terminal 100 and the reception terminal 200. The form of the communication by the communication section 460 is not particularly limited, and the communication by the communication section 460 may be wireless communication, or may be wired communication. Note that, while the communication section 460 is integrated with the server apparatus 400 in the example shown in FIG. 18, the communication section 460 may be constituted separately from the server apparatus 400.
Heretofore, a functional configuration example of the server apparatus 400 according to the third embodiment of the present disclosure has been described.
<3-4. Operation example of the control system>
To continue, an operation example of the control system 10 according to the third embodiment of the present disclosure will be described. FIG. 19 is a sequence diagram which shows an operation example of the control system 10 according to the third embodiment of the present disclosure. In particular, the example shown in FIG. 19 corresponds to an example in which the transmission terminal 100 selects a connection partner. Further, the example shown in FIG. 19 corresponds to an example in which the transmission terminal 100 displays an image and the reception terminal 200 captures an image, and corresponds to an example in which the data transmitted from the transmission terminal 100 to the reception terminal 200 is a video image Im1.
S113 to S117 shown in FIG. 19 can be executed the same as S113 to S117 shown in FIG. 7. Therefore, here, S101 to S112 shown in FIG. 19 will be mainly described.
First, the communication control section 113 in the transmission terminal 100 transmits a detection signal for detecting a terminal in the surroundings, and the communication control section 213 in the reception terminal 200 transmits a detection signal for detecting a terminal in the surroundings (S101). The communication control section 213 controls the communication section 260 so as to notify the terminal in the surroundings that connection to a camera is possible (S102). Note that, it may not be necessary to notify that connection to a camera is possible.
To continue, the display control section 111 displays an image on the display section 170 (S103), and when a feature amount of the display image is extracted (S104), the communication control section 113 controls the communication section 160 so that the feature amount of the display image and additional information are transmitted to the server apparatus 400 (S108A). On the other hand, an image is captured by the imaging section 230 (S105), and when a feature amount of the captured image is extracted by the captured image acquisition section 212 (S107), the communication control section 213 controls the communication section 160 so that the feature amount of the captured image and additional information are transmitted to the server apparatus 400 (S108B).
Here, the additional information is information additionally used other than the feature amount, and may be sensor data (for example, position information, reception intensities of electric waves, or a feature amount of audio data) detected by the detection section 140, or may be an IP address.
In this way, in the case where the information acquisition section 311 acquires additional information from the transmission terminal 100 and acquires additional information from the reception terminal 200, the comparison section 312 may additionally compare the additional information acquired from the transmission terminal 100 and the additional information acquired from the reception terminal 200. According to such a configuration, it becomes possible to further reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, compared to the case where only the feature amounts are to be compared.
Note that, since the additional information is information additionally used other than the feature amounts, it is not information which may necessarily have to be provided. When a feature amount and additional information are acquired from the transmission terminal 100 and a feature amount and additional information are acquired from the reception terminal 200 by the information acquisition section 311, the comparison section 312 compares both feature amounts and both additional information (S110).
To continue, in the case where the reception terminal 200 which receives a detection signal is present, the transmission control section 313 controls the communication section 160 so that a connection request is transmitted to this reception terminal 200 (S109). When the communication control section 213 controls the communication section 260 so that the connection request is received from the transmission terminal 100, in the case where it is judged that a comparison result between the feature amounts shows matching or similarities, and a comparison result between the additional information shows matching or similarities, the communication control section 213 controls the communication section 260 so that a connection response is transmitted to the transmission terminal 100 (S111), and the communication control section 113 controls the communication section 160 so that a confirmation message is transmitted to the reception terminal 200 (S112).
Heretofore, an operation example of the control system 10 according to the third embodiment of the present disclosure has been described.
<<4. Hardware Configuration Examples>>
To continue, a hardware configuration example of the transmission terminal 100 according to an embodiment of the present disclosure will be described. FIG. 20 is a figure which shows a hardware configuration example of the transmission terminal 100 according to an embodiment of the present disclosure. However, the hardware configuration example shown in FIG. 20 merely shows one example of a hardware configuration of the transmission terminal 100. Therefore, the hardware configuration of the transmission terminal 100 is not limited to the example shown in FIG. 20. The hardware of the reception terminal 200 can also be configured the same as that of the hardware of the transmission terminal 100.
As shown in FIG. 20, the transmission terminal 100 includes a CPU (Central Processing Unit) 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, a sensor 804, an input apparatus 808, an output apparatus 810, a storage apparatus 811, a drive 812, an imaging apparatus 813, and a communication apparatus 815.
The CPU 801 functions as a calculation processing apparatus and a control apparatus, and controls all the operations within the transmission terminal 100 in accordance with various programs. Further, the CPU 801 may be a microprocessor. The ROM 802 stores programs, calculation parameters or the like which are used by the CPU 801. The RAM 803 temporarily stores programs used in the execution of the CPU 801, parameters which arbitrarily change in this execution, or the like. These sections are mutually connected by a host bus constituted from a CPU bus or the like.
The sensor 804 is constituted from a sensor for detecting a state of the transmission terminal 100 and this peripheral circuit. A GPS antenna, an inclination sensor, an acceleration sensor, a direction sensor, a temperature sensor, a humidity sensor, an illumination sensor or the like can be included as the sensor 804. Sensor data detected by the sensor 804 is sent to the CPU 801. In this way, the CPU 801 can know the state of the transmission terminal 100 (present position, inclination, acceleration, direction, temperature, humidity, illumination or the like).
The input apparatus 808 includes an input section, such as a mouse, a keyboard, a touch panel, buttons, a microphone, switches or leavers, for a user to input information, and an input control circuit which generates an input signal based on an input by the user, and outputs the input signal to the CPU 801. By operating this input apparatus 808, the user of the transmission terminal 100 can input various types of data for the transmission terminal 100 and can instruct process operations.
The output apparatus 810 includes, for example, a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp. In addition, the output apparatus 810 includes an audio output apparatus such as a speaker or headphones. For example, the display device displays a captured image, a generated image or the like. On the other hand, the audio output apparatus converts audio data to sounds and outputs the sounds.
The storage apparatus 811 is an apparatus for data storage constituted as an example of a storage section of the transmission terminal 100. The storage apparatus 811 may include a storage medium, a recording apparatus which records data to the storage medium, a reading apparatus which reads data from the storage medium, and an erasure apparatus which erases data recorded in the storage medium. This storage apparatus 811 stores programs executed by the CPU 801 and various types of data.
The drive 812 is a reader/writer for the storage medium, and is built into the transmission terminal 100 or is externally attached. The drive 812 reads information recorded on a removable storage medium, such as a mounted magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 803. Further, the drive 812 can write information to the removable storage medium.
The imaging apparatus 813 includes an imaging optical system such as an imaging lens which condenses light, a zoom lens or the like, and a signal conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging optical system forms an image of a photographic subject on a signal conversion section by condensing light emitted from the photographic subject, and the signal conversion element converts the formed image of the photographic subject into electrical image signals.
The communication apparatus 815 is, for example, a communication interface constituted by a communication device or the like for connecting to a network. Further, the communication apparatus 815 may be a wired communication apparatus which communicates by wires, even if the communication apparatus 815 is a communication apparatus adaptive to wireless LAN (Local Area Network) or LTE (Long Term Evolution). For example, it is possible for the communication apparatus 815 to communicate with another apparatus via a network.
Heretofore, a hardware configuration example of the transmission terminal 100 according to an embodiment of the present disclosure has been described.
To continue, a hardware configuration example of the server apparatus 400 according to an embodiment of the present disclosure will be described. FIG. 21 is a figure which shows a hardware configuration example of the server apparatus 400 according to an embodiment of the present disclosure. However, the hardware configuration example shown in FIG. 21 merely shows one example of a hardware configuration of the server apparatus 400. Therefore, the hardware configuration of the server apparatus 400 is not limited to the example shown in FIG. 21.
As shown in FIG. 21, the server apparatus 400 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a storage apparatus 911, a drive 912, and a communication apparatus 915.
The CPU 901 functions as a calculation processing apparatus and a control apparatus, and controls all the operations within the server apparatus 400 in accordance with various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs, calculation parameters or the like which are used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters which arbitrarily change in this execution, or the like. These sections are mutually connected by a host bus constituted from a CPU bus or the like.
The storage apparatus 911 is an apparatus for data storage constituted as an example of a storage section of the server apparatus 400. The storage apparatus 911 may include a storage medium, a recording apparatus which records data to the storage medium, a reading apparatus which reads data from the storage medium, and an erasure apparatus which erases data recorded in the storage medium. This storage apparatus 911 stores programs executed by the CPU 901 and various types of data.
The drive 912 is a reader/writer for the storage medium, and is built into the server apparatus 400 or is externally attached. The drive 912 reads information recorded on a removable storage medium, such as a mounted magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. Further, the drive 912 can write information to the removable storage medium.
The communication apparatus 915 is, for example, a communication interface constituted by a communication device or the like for connecting to a network. Further, the communication apparatus 915 may be a wired communication apparatus which communicates by wires, even if the communication apparatus 915 is a communication apparatus adaptive to wireless LAN (Local Area Network) or LTE (Long Term Evolution). For example, it is possible for the communication apparatus 915 to communicate with another apparatus via a network.
<<5. Conclusion>>
As described above, according to embodiments of the present disclosure, a control apparatus 300 is provided, which includes an information acquisition section 311 which acquires information of a display image displayed by one terminal out of a transmission terminal 100 and a reception terminal 200, and information of a captured image captured by the other terminal, a comparison section 312 which obtains a comparison result by comparing the information of the display image and the information of the captured image, and a transmission control section 313 which controls whether or not data is transmitted from the transmission terminal 100 to the reception terminal 200 in accordance with the comparison result.
According to such a configuration, it is possible to reduce the possibility that incorrect data transmission is performed from the transmission terminal 100 to the reception terminal 200, while reducing the complexity of operations provided to a user. Further, according to such a configuration, it is possible to reduce the time which may be necessary for storing desired data in the reception terminal 200.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Further, a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described transmission terminal 100 can be created. Further, a computer-readable storage medium, on which this program is recorded, can also be provided. Further, a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described reception terminal 200 can be created. Further, a computer-readable storage medium, on which this program is recorded, can also be provided.
Further, a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described control apparatus 300 can be created. Further, a computer-readable storage medium, on which this program is recorded, can also be provided. Further, a program for causing hardware, such as a CPU, ROM and RAM built into a computer, to exhibit functions similar to the functions of the above described server apparatus 400 can be created.
(1)
A control apparatus including:
an information acquisition section which acquires information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal;
a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image; and
a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
(2)
The control apparatus according to (1),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least a video image.
(3)
The control apparatus according to (2),
wherein the video image transmitted from the transmission terminal to the reception terminal includes at least a video image displayed by the transmission terminal.
(4)
The control apparatus according to any one of (1) to (3),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least an application.
(5)
The control apparatus according to (4),
wherein the application transmitted from the transmission terminal to the reception terminal includes at least an application that is being executed by the transmission terminal.
(6)
The control apparatus according to any one of (1) to (5),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least an application execution state in the transmission terminal and a file generated by an application execution.
(7)
The control apparatus according to any one of (1) to (6),
wherein, in a case where the comparison result shows matching or a similarity between the information of the display image and the information of the captured image, the transmission control section causes the data to be transmitted from the transmission terminal to the reception terminal.
(8)
The control apparatus according to any one of (1) to (7),
wherein the information of the display image includes a feature amount extracted from the display image, and the information of the captured image includes a feature amount extracted from the captured image.
(9)
The control apparatus according to any one of (1) to (7),
wherein the information of the display image includes a part or all of the display image, and the information of the captured image includes a part or all of the captured image.
(10)
The control apparatus according to any one of (1) to (9),
wherein the information acquisition section acquires additional information from the transmission terminal, and acquires additional information from the reception terminal, and
wherein the comparison section further compares the additional information acquired from the transmission terminal and the additional information acquired from the reception terminal.
(11)
The control apparatus according to any one of (1) to (10),
wherein, in a case where a difference between a time when the display image is acquired and a time when the captured image is acquired is within a prescribed range, the comparison section compares the information of the display image and the information of the captured image.
(12)
The control apparatus according to any one of (1) to (11),
wherein the control apparatus is incorporated into the transmission terminal.
(13)
The control apparatus according to any one of (1) to (11),
wherein the control apparatus is incorporated into the reception terminal.
(14)
The control apparatus according to any one of (1) to (11),
wherein the control apparatus is incorporated into a server apparatus different from the transmission terminal and the reception terminal.
(15)
A control method including:
acquiring information of a display image displayed by one terminal out of a transmission terminal and a reception terminal, and information of a captured image captured by the other terminal;
obtaining a comparison result by comparing the information of the display image and the information of the captured image; and
controlling whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result.
(16)
A transmission terminal including:
a communication control section which causes a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
(17)
The transmission terminal according to (16),
wherein data transmitted to the reception terminal includes at least a video image.
(18)
The transmission terminal according to (16) or (17),
wherein data transmitted to the reception terminal includes at least an application.
(19)
The transmission terminal according to any one of (16) to (18),
wherein data transmitted to the reception terminal includes at least an application execution state in the transmission terminal.
(20)
The transmission terminal according to any one of (16) to (19),
wherein, in a case where a distance to the reception terminal becomes greater than a prescribed distance, the communication control section switches a transmission line of data transmitted by the communication section from a wireless LAN to a public wireless network.
(21)
A transmission method including:
causing a communication section to perform data communication to a reception terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a transmission terminal and the reception terminal, and information of a captured image captured by the other terminal.
(22)
A reception terminal including:
a communication control section which causes a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of the reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
(23)
The reception terminal according to (22), further including:
a display control section which causes a video image to be displayed on a display section, the video image being based on the data received from the transmission terminal.
(24)
The reception terminal according to (23),
wherein, when the data is received from the transmission terminal, the display control section performs a transition of a display by the display section from an image captured by an imaging section to a video image based on the data received from the transmission terminal.
(25)
The reception terminal according to (23) or (24),
wherein the data received from the transmission terminal includes at least a video image, an application execution state, and a file generated by an application execution, and
wherein, in a case where a distance to the transmission terminal becomes greater than a prescribed distance, the display control section switches a display by the display section from the video image to an execution result of an application based on the application execution state and the file.
(26)
The reception terminal according to any one of (23) to (25),
wherein the data received from the transmission terminal includes at least a video image, an application, an application execution state, and a file generated by an application execution, and
wherein the display control section prepares for displaying an execution result of the application while displaying the video image on the display section, and when a prescribed timing is reached, switches a display by the display section from the video image to the execution result of the application based on the application execution state and the file.
(27)
A reception method including:
causing a communication section to receive data from a transmission terminal, in a case where it is judged that a comparison result shows matching or a similarity between information of a display image displayed by one terminal out of a reception terminal and the transmission terminal, and information of a captured image captured by the other terminal.
(28)
A control system including:
a control apparatus;
a transmission terminal; and
a reception terminal,
wherein the control apparatus includes
an information acquisition section which acquires information of a display image displayed by one terminal out of the transmission terminal and the reception terminal, and information of a captured image captured by the other terminal,
a comparison section which obtains a comparison result by comparing the information of the display image and the information of the captured image, and
a transmission control section which controls whether or not data is transmitted from the transmission terminal to the reception terminal, in accordance with the comparison result,
wherein the transmission terminal includes
a communication control section which causes a communication section to perform data communication to the reception terminal, in a case where it is judged that the comparison result shows matching or a similarity, and
wherein the reception terminal includes
a communication control section which causes a communication section to receive data from the transmission terminal, in a case where it is judged that the comparison result shows matching or a similarity.
(29)
A control apparatus including:
a circuitry configured to
initiate an acquisition of information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal;
obtain a comparison result by comparing the information of the display image and the information of the captured image; and
control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
(30)
The control apparatus according to (29),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least a video image.
(31)
The control apparatus according to (29) or (30),
wherein the video image transmitted from the transmission terminal to the reception terminal corresponds to a video image displayed by the transmission terminal.
(32)
The control apparatus according to any one of (29) to (31),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least an application.
(33)
The control apparatus according to any one of (29) to (32),
wherein the application transmitted from the transmission terminal to the reception terminal corresponds to an application that is being executed by the transmission terminal.
(34)
The control apparatus according to any one of (29) to (33),
wherein the data transmitted from the transmission terminal to the reception terminal includes at least information regarding an application execution state within the transmission terminal and a data file generated by an application execution.
(35)
The control apparatus according to any one of (29) to (34),
wherein, in a case where the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image, the data is controlled to be transmitted from the transmission terminal to the reception terminal.
(36)
The control apparatus according to any one of (29) to (35),
wherein the information of the display image includes a feature amount extracted from the display image, and the information of the captured image includes a feature amount extracted from the captured image.
(37)
The control apparatus according to any one of (29) to (36),
wherein the information of the display image includes a part or all of the display image, and the information of the captured image includes a part or all of the captured image.
(38)
The control apparatus according to any one of (29) to (37),
wherein the circuitry is further configured to initiate an acquisition of additional information from the transmission terminal, initiate an acquisition of additional information from the reception terminal, and initiate a comparison of the additional information acquired from the transmission terminal and the additional information acquired from the reception terminal.
(39)
The control apparatus according to any one of (29) to (38),
wherein, in a case where a difference between a time when the display image is being displayed and a time when the captured image is being captured is within a prescribed range, the circuitry initiates the comparison of the information of the display image and the information of the captured image.
(40)
The control apparatus according to any one of (29) to (39),
wherein the control apparatus is incorporated into the transmission terminal.
(41)
The control apparatus according to any one of (29) to (40),
wherein the control apparatus is incorporated into the reception terminal.
(42)
The control apparatus according to any one of (29) to (41),
wherein the control apparatus is incorporated into a server apparatus different from the transmission terminal and the reception terminal.
(43)
A control method including:
acquiring information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal;
obtaining a comparison result by comparing the information of the display image and the information of the captured image; and
controlling whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
(44)
A transmission terminal including:
a circuitry configured to initiate a transmission of data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
(45)
The transmission terminal according to (44),
wherein the data transmitted to the reception terminal includes at least a video image.
(46)
The transmission terminal according to (44) or (45),
wherein data transmitted to the reception terminal includes at least an application.
(47)
The transmission terminal according to any one of (44) to (46),
wherein data transmitted to the reception terminal includes at least information regarding an application execution state within the transmission terminal.
(48)
The transmission terminal according to any one of (44) to (47),
wherein, in a case where a distance to the reception terminal becomes greater than a prescribed distance, the circuitry initiates a switching of the data transmission by the transmission terminal from utilizing a wireless LAN to utilizing a public wireless network.
(49)
A transmission method including:
transmitting data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
(50)
A reception terminal including:
a circuitry configured to initiate a reception of data sent from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the reception terminal and the transmission terminal, and information of a captured image captured by the other one of the reception terminal and the transmission terminal.
(51)
The reception terminal according to (50),
wherein the circuitry is further configured to initiate a displaying of a video image, the video image being based on the data received from the transmission terminal.
(52)
The reception terminal according to (50) or (51),
wherein, when the data is received from the transmission terminal, the circuitry initiates a transition of a display from the captured image to the video image that is based on the data received from the transmission terminal.
(53)
The reception terminal according to any one of (50) to (52),
wherein the data received from the transmission terminal includes at least a video image, an information regarding an application execution state, and a data file generated by an application execution, and
wherein, in a case where a distance to the transmission terminal becomes greater than a prescribed distance, the circuitry initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
(54)
The reception terminal according to any one of (50) to (53),
wherein the data received from the transmission terminal includes at least a video image, an application, an information regarding an application execution state, and a data file generated by an application execution, and
wherein the circuitry further initiates a displaying of an execution result of the application while displaying the video image, and when a prescribed timing is reached, initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
(55)
A reception method including:
receiving data from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
(56)
A control system including:
a control apparatus;
a transmission terminal; and
a reception terminal,
wherein the control apparatus includes a circuitry configured to
initiate an acquisition of information of a display image displayed by one of the transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal,
obtain a comparison result by comparing the information of the display image and the information of the captured image, and
control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result,
wherein the transmission terminal includes a circuitry configured to
initiate a transmission of data to the reception terminal, in a case when a judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image, and
wherein the reception terminal includes a circuitry configured to
initiate a reception of the data sent from the transmission terminal, in a case when the judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image.
10 control system
100 transmission terminal
110 control section
111 display control section
112 captured image acquisition section
113 communication control section
120 input section
130 imaging section
140 detection section
150 storage section
160 communication section
170 display section
200 reception terminal
210 control section
211 display control section
212 captured image acquisition section
213 communication control section
220 input section
230 imaging section
240 detection section
250 storage section
260 communication section
270 display section
300 control apparatus
311 information acquisition section
312 comparison section
313 transmission control section
400 server apparatus
410 control section
450 storage section
460 communication section

Claims (28)

  1. A control apparatus comprising:
    a circuitry configured to
    initiate an acquisition of information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal;
    obtain a comparison result by comparing the information of the display image and the information of the captured image; and
    control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
  2. The control apparatus according to claim 1,
    wherein the data transmitted from the transmission terminal to the reception terminal includes at least a video image.
  3. The control apparatus according to claim 2,
    wherein the video image transmitted from the transmission terminal to the reception terminal corresponds to a video image displayed by the transmission terminal.
  4. The control apparatus according to claim 1,
    wherein the data transmitted from the transmission terminal to the reception terminal includes at least an application.
  5. The control apparatus according to claim 4,
    wherein the application transmitted from the transmission terminal to the reception terminal corresponds to an application that is being executed by the transmission terminal.
  6. The control apparatus according to claim 1,
    wherein the data transmitted from the transmission terminal to the reception terminal includes at least information regarding an application execution state within the transmission terminal and a data file generated by an application execution.
  7. The control apparatus according to claim 1,
    wherein, in a case where the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image, the data is controlled to be transmitted from the transmission terminal to the reception terminal.
  8. The control apparatus according to claim 1,
    wherein the information of the display image includes a feature amount extracted from the display image, and the information of the captured image includes a feature amount extracted from the captured image.
  9. The control apparatus according to claim 1,
    wherein the information of the display image includes a part or all of the display image, and the information of the captured image includes a part or all of the captured image.
  10. The control apparatus according to claim 1,
    wherein the circuitry is further configured to initiate an acquisition of additional information from the transmission terminal, initiate an acquisition of additional information from the reception terminal, and initiate a comparison of the additional information acquired from the transmission terminal and the additional information acquired from the reception terminal.
  11. The control apparatus according to claim 1,
    wherein, in a case where a difference between a time when the display image is being displayed and a time when the captured image is being captured is within a prescribed range, the circuitry initiates the comparison of the information of the display image and the information of the captured image.
  12. The control apparatus according to claim 1,
    wherein the control apparatus is incorporated into the transmission terminal.
  13. The control apparatus according to claim 1,
    wherein the control apparatus is incorporated into the reception terminal.
  14. The control apparatus according to claim 1,
    wherein the control apparatus is incorporated into a server apparatus different from the transmission terminal and the reception terminal.
  15. A control method comprising:
    acquiring information of a display image displayed by one of a transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal;
    obtaining a comparison result by comparing the information of the display image and the information of the captured image; and
    controlling whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result.
  16. A transmission terminal comprising:
    a circuitry configured to initiate a transmission of data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  17. The transmission terminal according to claim 16,
    wherein the data transmitted to the reception terminal includes at least a video image.
  18. The transmission terminal according to claim 16,
    wherein data transmitted to the reception terminal includes at least an application.
  19. The transmission terminal according to claim 16,
    wherein data transmitted to the reception terminal includes at least information regarding an application execution state within the transmission terminal.
  20. The transmission terminal according to claim 16,
    wherein, in a case where a distance to the reception terminal becomes greater than a prescribed distance, the circuitry initiates a switching of the data transmission by the transmission terminal from utilizing a wireless LAN to utilizing a public wireless network.
  21. A transmission method comprising:
    transmitting data to a reception terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of a transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  22. A reception terminal comprising:
    a circuitry configured to initiate a reception of data sent from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the reception terminal and the transmission terminal, and information of a captured image captured by the other one of the reception terminal and the transmission terminal.
  23. The reception terminal according to claim 22,
    wherein the circuitry is further configured to initiate a displaying of a video image, the video image being based on the data received from the transmission terminal.
  24. The reception terminal according to claim 23,
    wherein, when the data is received from the transmission terminal, the circuitry initiates a transition of a display from the captured image to the video image that is based on the data received from the transmission terminal.
  25. The reception terminal according to claim 23,
    wherein the data received from the transmission terminal includes at least a video image, an information regarding an application execution state, and a data file generated by an application execution, and
    wherein, in a case where a distance to the transmission terminal becomes greater than a prescribed distance, the circuitry initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
  26. The reception terminal according to claim 23,
    wherein the data received from the transmission terminal includes at least a video image, an application, an information regarding an application execution state, and a data file generated by an application execution, and
    wherein the circuitry further initiates a displaying of an execution result of the application while displaying the video image, and when a prescribed timing is reached, initiates a switching of a display from the video image to an execution result of the execution of the application based on the information regarding the application execution state and the data file.
  27. A reception method comprising:
    receiving data from a transmission terminal, in a case when a judgment is made that a comparison result indicates a matching or a similarity between information of a display image displayed by one of the transmission terminal or a reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal.
  28. A control system comprising:
    a control apparatus;
    a transmission terminal; and
    a reception terminal,
    wherein the control apparatus includes a circuitry configured to
    initiate an acquisition of information of a display image displayed by one of the transmission terminal or the reception terminal, and information of a captured image captured by the other one of the transmission terminal or the reception terminal,
    obtain a comparison result by comparing the information of the display image and the information of the captured image, and
    control whether or not data is transmitted from the transmission terminal to the reception terminal, based on the comparison result,
    wherein the transmission terminal includes a circuitry configured to
    initiate a transmission of data to the reception terminal, in a case when a judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image, and
    wherein the reception terminal includes a circuitry configured to
    initiate a reception of the data sent from the transmission terminal, in a case when the judgment is made that the comparison result indicates a matching or a similarity between the information of the display image and the information of the captured image,.
PCT/JP2014/003875 2013-08-01 2014-07-23 Control apparatus, control method, transmission terminal, transmission method, reception terminal, reception method, and control system WO2015015765A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013160132A JP2015032934A (en) 2013-08-01 2013-08-01 Control device, control method, transmission terminal, transmission method, reception terminal, reception method, and control system
JP2013-160132 2013-08-01

Publications (1)

Publication Number Publication Date
WO2015015765A1 true WO2015015765A1 (en) 2015-02-05

Family

ID=51492999

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/003875 WO2015015765A1 (en) 2013-08-01 2014-07-23 Control apparatus, control method, transmission terminal, transmission method, reception terminal, reception method, and control system

Country Status (2)

Country Link
JP (1) JP2015032934A (en)
WO (1) WO2015015765A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000082108A (en) 1998-06-30 2000-03-21 Sony Corp Two-dimensional code recognition processing method, device therefor and medium
WO2007077521A2 (en) * 2006-01-06 2007-07-12 Nokia Corporation System and method for managing captured content
US20100331041A1 (en) * 2009-06-26 2010-12-30 Fuji Xerox Co., Ltd. System and method for language-independent manipulations of digital copies of documents through a camera phone
EP2299349A1 (en) * 2009-08-20 2011-03-23 Samsung Electronics Co., Ltd. Data transfer method and system
EP2391109A1 (en) * 2010-05-28 2011-11-30 Robert Bosch Gmbh Visual pairing and data exchange between devices using barcodes for data exchange with mobile navigation systems
EP2523439A1 (en) * 2011-05-11 2012-11-14 Sony Mobile Communications AB System and method for pairing hand-held devices utilizing a front-facing camera

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5354664B2 (en) * 2009-05-28 2013-11-27 Necカシオモバイルコミュニケーションズ株式会社 Digital data receiver and program
JP2011091578A (en) * 2009-10-21 2011-05-06 Canon Inc Video determination device, video display device, and method for controlling them, program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000082108A (en) 1998-06-30 2000-03-21 Sony Corp Two-dimensional code recognition processing method, device therefor and medium
WO2007077521A2 (en) * 2006-01-06 2007-07-12 Nokia Corporation System and method for managing captured content
US20100331041A1 (en) * 2009-06-26 2010-12-30 Fuji Xerox Co., Ltd. System and method for language-independent manipulations of digital copies of documents through a camera phone
EP2299349A1 (en) * 2009-08-20 2011-03-23 Samsung Electronics Co., Ltd. Data transfer method and system
EP2391109A1 (en) * 2010-05-28 2011-11-30 Robert Bosch Gmbh Visual pairing and data exchange between devices using barcodes for data exchange with mobile navigation systems
EP2523439A1 (en) * 2011-05-11 2012-11-14 Sony Mobile Communications AB System and method for pairing hand-held devices utilizing a front-facing camera

Also Published As

Publication number Publication date
JP2015032934A (en) 2015-02-16

Similar Documents

Publication Publication Date Title
CN110850593B (en) Mobile device and method for pairing electronic devices by mobile device
JP6318269B2 (en) Equipment control method, equipment control apparatus, computer program, and computer-readable storage medium
US9014685B2 (en) Mobile device which automatically determines operating mode
JP5358733B2 (en) System and method for changing touch screen functionality
US20140184726A1 (en) Display apparatus and method for video calling thereof
KR101227331B1 (en) Method for transmitting and receiving data and display apparatus thereof
TWI544336B (en) Classes,electronic device and method of pairing thereof and seamless content playback method
CN104202624B (en) The method of transmission picture and device
US10530958B2 (en) Information processing device, information processing system, and method for controlling information processing device
US20230262321A1 (en) Electronic device and operating method thereof
CN114466084A (en) Method and electronic device for detecting video monitoring device
US10863095B2 (en) Imaging apparatus, imaging method, and imaging program
KR20180031239A (en) Mobile terminal and method for controlling the same
US9992419B2 (en) Display control apparatus for displaying a virtual object
US10013949B2 (en) Terminal device
KR20120017555A (en) Method for switching video call device and video call device thereof
WO2015015765A1 (en) Control apparatus, control method, transmission terminal, transmission method, reception terminal, reception method, and control system
CN104184943B (en) Image capturing method and device
US11146741B2 (en) Electronic device and method for capturing and displaying image
KR20170059693A (en) Mobile device and, the method thereof
KR20170021038A (en) Mobile terminal and method for controlling the same
JP2020120295A (en) Communication device, control method of the same, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14761422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14761422

Country of ref document: EP

Kind code of ref document: A1