WO2024034350A1 - Système de dialogue en ligne vidéo et programme - Google Patents

Système de dialogue en ligne vidéo et programme Download PDF

Info

Publication number
WO2024034350A1
WO2024034350A1 PCT/JP2023/026666 JP2023026666W WO2024034350A1 WO 2024034350 A1 WO2024034350 A1 WO 2024034350A1 JP 2023026666 W JP2023026666 W JP 2023026666W WO 2024034350 A1 WO2024034350 A1 WO 2024034350A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
chat
video
image
terminal
Prior art date
Application number
PCT/JP2023/026666
Other languages
English (en)
Japanese (ja)
Inventor
崇 古庄
智仁 藤原
Original Assignee
三菱自動車工業株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱自動車工業株式会社 filed Critical 三菱自動車工業株式会社
Publication of WO2024034350A1 publication Critical patent/WO2024034350A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/123—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams
    • G08G1/127—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams to a central station ; Indicators in a central station
    • G08G1/13—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams to a central station ; Indicators in a central station the indicator being in the form of a map
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • This case relates to a video chat system and program to support communication.
  • chat systems have been developed that enable real-time communication using text and images between occupants of multiple vehicles via networks such as mobile phone lines and the Internet.
  • a chat system has been proposed that allows a plurality of vehicles to share a map image representing the driving position of a vehicle and exchange messages with each other.
  • map images By sharing map images within a chat group, it becomes easier to discuss destinations and driving routes, and smooth communication can be achieved (see, for example, Patent Document 1).
  • the above chat system is suitable for use when multiple people drive in multiple vehicles and communicate while driving the vehicles.
  • just exchanging text, images, and map images makes it difficult to convey the sense of realism and enjoyment of driving experienced by the occupants of the vehicle to users who are not in the vehicle, making it difficult to achieve good communication.
  • the problem is that it is difficult.
  • One of the purposes of this case was to provide a video chat system and program that was created in light of the above-mentioned issues and that enables good communication.
  • this purpose is not limited to this purpose, and it is also possible to achieve effects derived from each configuration shown in "Details for Carrying Out the Invention" that will be described later, which cannot be obtained with conventional techniques. It is positioned as a purpose.
  • the disclosed video chat system and program can be realized as the embodiments or application examples disclosed below, and solve at least part of the above problems.
  • the disclosed video chat system is a video chat system for supporting communication in a chat group including occupants of a vehicle equipped with an on-board computer and users who are not occupants of the vehicle, and is installed in the vehicle.
  • control means for displaying for a video chat system for supporting communication in a chat group including occupants of a vehicle equipped with an on-board computer and users who are not occupants of the vehicle, and is installed in the vehicle.
  • a distribution means for distributing vehicle surrounding video captured by an imaging device to the chat group and a distribution means for distributing vehicle surrounding video captured by an imaging device to the chat group
  • the disclosed program is a program for supporting communication in a chat group including occupants of a vehicle equipped with an on-vehicle computer and users who are not occupants of the vehicle, and the program supports communication in a chat group that includes an occupant of a vehicle equipped with an on-board computer and a user who is not an occupant of the vehicle.
  • the computer performs a process of distributing the video surrounding the vehicle to the chat group, and displaying messages exchanged within the chat group and the video surrounding the vehicle on chat screens of a terminal in the vehicle and a terminal of the user. Let it run.
  • the disclosed video chat system and program by displaying images around the vehicle captured by an imaging device mounted on the vehicle on the chat screen, it is possible to display the real scenery and environment that the occupants of the vehicle are viewing. You can present it to a chat group and share the realism and fun of driving. Therefore, good communication can be achieved.
  • FIG. 1 is a block diagram of a video chat system. It is a block diagram of a program. 3 is a flowchart showing the flow of control related to information distribution. 5 is a flowchart showing the flow of control related to displaying information.
  • FIG. 1 is a block diagram of a video chat system. It is a block diagram of a program. 3 is a flowchart showing the flow of control related to information distribution. 5 is a flowchart showing the flow of control related to displaying information.
  • (A) to (C) are schematic diagrams showing display examples of chat screens.
  • a video chat system is a system that supports real-time communication (chat, conversation) between multiple users via a computer, in which at least one or more occupants of a vehicle This is a system that allows you to distribute vehicle surrounding images) to other users.
  • Specific means of communication include, for example, characters, pictograms, images, video, audio, music, and the like.
  • chat screen A screen on which visual information related to communication is displayed is called a "chat screen.”
  • a program for controlling visual and auditory information displayed on the chat screen is installed and executed on at least one or more computers.
  • video chat systems include zoom (registered trademark), Microsoft Teams (registered trademark), LINE (registered trademark), and the like.
  • the disclosed video chat system has a function of distributing video captured by an imaging device mounted on a vehicle.
  • the video referred to here includes not only real images captured by an imaging device (raw data, live video), but also processed images obtained by performing image processing (synthesis processing, filter processing, effector processing, etc.) on real images.
  • a chat group refers to a group of users in which the content of communication (content of dialogue) is shared.
  • a place where communication takes place within a chat group is also called a "chat room", which is likened to a room.
  • Each user can belong to and leave a chat group using known authentication methods (for example, ID, password, invitation, etc.), and can belong to multiple chat rooms (multiple chat groups) at the same time. be.
  • FIGS. 1A and 1B are schematic diagrams showing a configuration example of a video chat system 1 as an embodiment.
  • a video chat system 1 shown in FIG. 1A includes a vehicle 10 equipped with an on-vehicle computer (terminal 10') and a terminal 20.
  • the video chat system 1 shown in FIG. 1(B) includes a plurality of vehicles 10, a plurality of terminals 20, and a server 30.
  • the number of vehicles 10, terminals 20, and servers 30 included in video chat system 1 can be set arbitrarily.
  • Video chat system 1 functions to support communication in a chat group including occupants of vehicle 10 and users who are not occupants of vehicle 10.
  • the on-vehicle computer means a computer (or a group of computers) mounted on the vehicle 10, and includes, for example, IVI (in-vehicle infotainment) and TCU (telematics control unit).
  • the terminal 20 refers to a computer (or a group of computers) that is not installed in the vehicle 10, such as a smartphone, a desktop computer, a notebook computer, or a PDA (personal digital assistant).
  • the in-vehicle computer (terminal 10') of the vehicle 10 and the terminal 20 can communicate directly, for example, through a P2P (peer-to-peer) connection, or via a network 40 (for example, the network 40) such as a mobile phone network or the Internet. Communication is possible via constituent servers, telecommunications carrier base stations, wireless routers, etc.).
  • FIG. 2 is a block diagram for explaining the device configuration of the terminal 10', terminal 20, and server 30 included in the video chat system 1.
  • the video chat system 1 may include a plurality of terminals 10', terminals 20, and servers 30, but they are simplified in the figure.
  • the terminal 10' is provided with an electronic control device 11, a display device 12, an input device 13, a storage device 14, a communication device 15, a positioning device 16, an audio device 17, an imaging device 18, and a microphone 19 (microphone). Also connected to the terminal 10' are sensors (not shown) for detecting running information (vehicle speed and output information) representing the running state of the vehicle 10.
  • running information vehicle speed and output information
  • the electronic control device 11 is an electronic control device (computer) equipped with a processor and a memory. When a plurality of electronic control devices are mounted on the vehicle 10, the entirety of them may be considered as the electronic control device 11 of this embodiment.
  • the display device 12 is one of the devices for visually outputting the calculation results of the electronic control device 11 and the chat screen, and is, for example, a liquid crystal display, an organic EL display, or a projector.
  • the display device 12 is installed near the instrument panel or dashboard of the vehicle 10.
  • the input device 13 is a device for inputting information to the electronic control device 11, and is, for example, a touch panel or physical keys (physical buttons) attached to the surface of the display device 12 in an overlapping state. Input of characters and pictograms for communication in the chat group is performed via the input device 13.
  • the storage device 14 is a memory device in which data and programs to be retained for a long period of time are stored, and is, for example, a flash memory, a solid state drive, or the like.
  • the application program of the video chat system 1 may be stored in the storage device 14.
  • the communication device 15 is an electronic control device (for example, a mobile communication device, a road-to-vehicle communication device, a vehicle-to-vehicle communication device, etc.) for performing wireless communication with other computers via the network 40.
  • the communication device 15 may be provided as an independent single device, or may be provided integrally with the electronic control device 11.
  • the positioning device 16 is an electronic control device (for example, a car navigation device) that measures the position of the vehicle 10 based on information detected by a GNSS (global navigation satellite system), a vehicle speed sensor, a steering angle sensor, a yaw rate sensor, etc. ).
  • the positioning device 16 may be provided as an independent single device, or may be provided integrally with the electronic control device 11.
  • the audio device 17 is a device that transmits auditory information such as voice and music to the occupants of the vehicle 10.
  • the imaging device 18 is a device that captures images of the scenery and environment around the vehicle 10 (vehicle surrounding images). Specific examples of the imaging device 18 include a video camera, an infrared camera, a still camera, and a radar.
  • the vehicle 10 of this embodiment is equipped with a plurality of video cameras shooting in different directions. For example, a front camera that photographs the traveling direction of the vehicle 10, a rear camera that photographs the rear, a right camera that photographs the right side, and a left camera that photographs the left side are installed.
  • the microphone 19 is a device for inputting information to the electronic control device 11, and is a device for converting sound into an electrical signal. Voice input for communication in the chat group is performed via microphone 19.
  • the device configuration of the terminal 20 is almost the same as the device configuration of the vehicle 10.
  • the terminal 20 is provided with an electronic control device 21, a display device 22, an input device 23, a storage device 24, a communication device 25, a positioning device 26, an audio device 27, an imaging device 28, and a microphone 29 (microphone).
  • the electronic control device 21 is an electronic control device (computer) equipped with a processor and memory
  • the display device 22 is, for example, a liquid crystal display or an organic EL display.
  • the input device 23 is a touch panel or physical keys
  • the storage device 24 is a flash memory, solid state drive, or the like.
  • the communication device 25 is an electronic control device for wirelessly communicating with other computers via the network 40, and the positioning device 26 measures the position of the terminal 20 based on detection information such as GNSS and wireless signal strength. It is an electronic control device.
  • the audio device 27 is a device that transmits auditory information such as voice and music to the user of the terminal 20, and the imaging device 28 is a device that acquires images of the surrounding scenery of the terminal 20 and the user of the terminal 20. 29 is a device that converts sound into an electrical signal.
  • the device configuration of the server 30 is simple compared to the vehicle 10 and the terminal 20, and corresponds to the terminal 20 without the positioning device 26, audio device 27, imaging device 28, and microphone 29.
  • the server 30 is provided with an electronic control device 31, a display device 32, an input device 33, a storage device 34, and a communication device 35.
  • the electronic control device 31 is an electronic control device (computer) equipped with a processor and memory
  • the display device 32 is, for example, a liquid crystal display or an organic EL display.
  • the input device 33 is a touch panel or physical keys
  • the storage device 34 is a hard disk drive, a solid state drive, etc.
  • the communication device 35 is an electronic device for wirelessly communicating with other computers via the network 40. It is a control device.
  • the disclosed program 2 is installed, for example, in each of the vehicle 10 and the terminal 20 and executed individually. Alternatively, it is installed and executed in at least one of the vehicle 10, the terminal 20, and the server 30. Alternatively, the program may be installed in a plurality of devices among the vehicle 10, the terminal 20, and the server 30, and executed in cooperation with each other. In the following description, it is assumed that the program 2 installed in each of the vehicle 10 and the terminal 20 is executed in cooperation with each other.
  • FIG. 3 is a block diagram conceptually showing the functions of the program 2.
  • the program 2 has a function of distributing messages, map images, videos, travel information, etc. to the chat group, and displaying the information distributed within the chat group on the chat screen of the terminal 10' and the user's terminal 20.
  • the message here includes, for example, characters, pictograms, images (stamps), audio, music, and the like.
  • the map image is an image of a map that includes position information of the vehicle 10 and the terminal 20 (information on positions measured by the positioning devices 16 and 26).
  • the image is a vehicle surrounding image (a real image, a processed image, etc.) captured by the imaging device 18.
  • the driving information is information representing the driving state of the vehicle 10 in which the vehicle surrounding image was photographed, and is, for example, information on vehicle speed and output.
  • the driving information includes information such as engine rotation speed, motor rotation speed, motor power consumption, energy consumption rate, remaining fuel, and battery charging rate.
  • the program 2 includes a distribution means 3 (second distribution means), a generation means 4, and a control means 5. These means are shown by classifying the functions of the program 2 for convenience, and each means may be written as an independent program or as a composite program that has these functions. good.
  • the program 2 is installed, for example, in the storage device 14 of the vehicle 10 or the storage device 24 of the terminal 20. It is assumed that the distribution means 3 and the generation means 4 of this embodiment do not function in the terminal 20.
  • the distribution means 3 has a function of distributing the vehicle surrounding video captured by the imaging device 18 mounted on the vehicle 10 to the chat group.
  • vehicle surrounding images photographed by each of the plurality of imaging devices 18 are distributed via the distribution means 3.
  • the distribution means 3 of this embodiment also distributes the overhead video of the vehicle 10 generated by the generation means 4 to the chat group.
  • the distribution of messages, map images, and traveling information may be performed by means other than the distribution means 3, or the distribution means 3 may be in charge of all information distribution.
  • the distribution means 3 in each vehicle 10 distributes the vehicle surrounding video obtained by that vehicle 10.
  • the generating means 4 has a function of generating an overhead image of the vehicle 10 based on vehicle surrounding images captured by a plurality of imaging devices 18 mounted on the vehicle 10.
  • the bird's-eye view image is an image that is equivalent to a projection of the scenery seen in an arbitrary direction (direction of sight) onto a two-dimensional plane from a position (viewpoint) different from the position where the plurality of imaging devices 18 are installed. It can be generated using a known image processing method (for example, see Japanese Patent Laid-Open No. 2002-109697).
  • the generating means 4 has a function of synthesizing a CG image of the vehicle 10 on the bird's-eye view image based on the viewpoint and line-of-sight direction of the bird's-eye view image. That is, the vehicle 10, which does not appear in the vehicle surroundings image captured by the imaging device 18, is synthesized as a CG image into the bird's-eye view image, thereby improving the reality of the bird's-eye view image.
  • the control means 5 has a function of displaying messages exchanged within the chat group and images of the surroundings of the vehicle on the chat screens of the terminal 10' in the vehicle 10 and the user's terminal 20.
  • a video of the vehicle surroundings and an overhead video captured by the imaging device 18 of the own vehicle can be displayed on the chat screen.
  • vehicle surrounding images and overhead images distributed via the network 40 can be displayed on the chat screen.
  • a map image including location information of the vehicle 10 where the vehicle surrounding video was taken can also be displayed on the chat screen.
  • the type of information displayed on the chat screen may be freely selected and set by the occupant of the vehicle 10 or the user of the terminal 20.
  • the following three types of modes may be prepared as the display mode of the chat screen, and the control means 5 may select one of them according to the operation of the occupant of the vehicle 10 or the user of the terminal 20. good.
  • - A first mode that displays a message and a video around the vehicle at the same time.
  • - A second mode that displays a message and a map image at the same time.
  • - A third mode that displays a message, a video around the vehicle, and a map image at the same time. Note that if there are multiple chat groups When the vehicle 10 includes occupants of the vehicle 10, the occupant of the vehicle 10 or the user of the terminal 20 may be allowed to freely select and view any of the vehicle surrounding videos distributed from each vehicle 10.
  • FIG. 4 is a flowchart showing the flow of control related to information distribution, which is executed by the vehicle 10.
  • the program 2 acquires position information and travel information of the vehicle 10. Position information is detected by the positioning device 16, and travel information is detected by sensors (not shown). If there is a message (text, pictograms, voice, etc.) detected by the input device 13 or the microphone 19, the program 2 also acquires that information.
  • step A2 the program 2 acquires a vehicle surrounding image photographed by the imaging device 18.
  • a plurality of vehicle surrounding images photographed by each of the plurality of imaging devices 18 are individually acquired.
  • the generation means 4 generates an overhead image of the vehicle 10 based on a plurality of vehicle surrounding images.
  • the CG image of the vehicle 10 may be combined onto the bird's-eye view video.
  • the distribution means 3 distributes travel information, messages, map images, and videos (real images and processed images thereof) to the chat group.
  • FIG. 5 is a flowchart showing the flow of control related to information display, and shows a vehicle 10 (vehicle 10 different from the vehicle 10 that distributed the information in step A4 of FIG. 4, hereinafter also referred to as "second vehicle 10"), It is executed on the terminal 20.
  • the program 2 acquires travel information, messages, map images, and videos (real images and processed images thereof) via the network 40. If there is a message (text, pictograms, voice, etc.) detected by the input devices 13, 23 or the microphones 19, 29, the program 2 also acquires the information.
  • a message text, pictograms, voice, etc.
  • step A6 if a plurality of vehicles 10 are distributing vehicle surrounding images to the chat group, the program 2 selects one of the vehicle surrounding images. For example, one of the vehicle surrounding images is selected according to the operation of the occupant of the vehicle 10 or the user of the terminal 20. Further, in step A7, one of the display modes is selected from among the first mode, second mode, and third mode according to the operation of the occupant of the vehicle 10 or the user of the terminal 20. In subsequent step A8, the control means 5 displays a message or the like on the chat screen.
  • FIG. 6(A) to 6(C) are schematic diagrams showing display examples of the chat screen.
  • FIG. 6(A) is the first mode
  • FIG. 6(B) is the second mode
  • FIG. 6(C) is the second mode.
  • This is an example of display in three modes.
  • a message 53 within the chat group and a vehicle surrounding video 54 distributed by the vehicle 10 are displayed simultaneously.
  • the chat screen is divided into upper and lower halves, and the message 53 is displayed on the lower screen.
  • a real image taken by the front camera of the vehicle 10 is displayed as a vehicle surroundings image 54.
  • travel information 55 of the vehicle 10 is preferably displayed at the same time.
  • information on vehicle speed and engine rotation speed is displayed superimposed on the vehicle surrounding image 54.
  • icons representing users in the chat group for example, the self icon 51 and the other person icon 52
  • the message 53 in the chat group and the map image 56 including the location information of the vehicle 10 are displayed simultaneously.
  • the chat screen is divided into upper and lower halves, and the message 53 is displayed on the lower screen.
  • a map image 56 showing the surrounding area around the current position of the vehicle 10 is displayed on the upper screen.
  • an icon resembling a car may be displayed at the position of the vehicle 10 in the map image 56.
  • the scale of the map image 56 may be changed by the user (or passenger) viewing the chat screen.
  • a message 53 in the chat group, a vehicle surrounding video 57 distributed by the vehicle 10, and a map image 56 are displayed simultaneously.
  • the chat screen is divided into three parts, top and bottom, and a message 53 is displayed on the bottom screen, and a map image 56 is displayed on the center screen.
  • On the upper screen for example, a bird's-eye view image generated based on vehicle surrounding images photographed by a plurality of imaging devices 18 is displayed as a vehicle surrounding image 57.
  • the travel information 55 of the vehicle 10 is simultaneously displayed superimposed on the vehicle surrounding image 57.
  • a vehicle surrounding image 54 as shown in FIG. 6(A) may be displayed on the upper screen.
  • the video chat system 1 of this embodiment is a video chat system for supporting communication in a chat group including the occupant of a vehicle 10 equipped with an on-vehicle computer (terminal 10') and a user using a terminal 20. It is 1.
  • This video chat system 1 includes a distribution means 3 for distributing vehicle surrounding video captured by an imaging device 18 mounted on a vehicle 10 to a chat group, and a chat screen on a terminal 10' in the vehicle 10 and a user's terminal 20. and a control means 5 for displaying messages exchanged within the chat group and images around the vehicle.
  • the program 2 of this embodiment is a program 2 for supporting communication in a chat group including the occupant of the vehicle 10 equipped with the on-vehicle computer (terminal 10') and the user using the terminal 20.
  • This program 2 distributes vehicle surrounding images captured by the imaging device 18 mounted on the vehicle 10 to the chat group, and displays the video on the chat screen of the terminal 10' in the vehicle 10 or the user's terminal 20 within the chat group.
  • a computer electronic control unit 11, 21 is caused to execute a process of displaying the exchanged messages and images around the vehicle.
  • the video chat system 1 and program 2 described above by displaying the video around the vehicle captured by the imaging device 18 mounted on the vehicle 10 on the chat screen, the real scenery seen by the occupants of the vehicle 10 is displayed. You can share the realism and fun of driving by showing your car and surroundings to a chat group. Additionally, the reality of the virtual driving experience can be improved compared to communication using text or pictograms. Therefore, good communication can be achieved.
  • the occupant of the vehicle 10 when the occupant of the vehicle 10 is driving alone, he or she can enjoy chatting with friends in the chat group. Furthermore, the user of the terminal 20 can see the real scenery and environment seen by the occupants of the vehicle 10, and can feel as if he or she is actually riding in the vehicle 10. Furthermore, when an elderly person or a novice driver drives the vehicle 10, by utilizing the video chat system 1 or program 2 described above, remote monitoring and communication such as a monitoring service can be realized, and the driver can It can reduce the psychological burden and technical burden of
  • the control means 5 of this embodiment can display a map image 56 including position information of the vehicle 10 on the chat screen.
  • the real current position of the vehicle 10 can be shared with high accuracy within the chat group, and the sense of realism of driving can be enhanced.
  • the user of the terminal 20 can easily ask the occupants of the vehicle 10 questions about the destination or destination while viewing the map image 56, or convey requests regarding the route to be traveled. Therefore, good communication can be achieved.
  • the control means 5 of this embodiment controls the display of the chat screen between the first mode, the second mode, and the third mode according to the operation of the passenger or the user. You can display one of the modes. With this configuration, the occupants of the vehicle 10 and the user of the terminal 20 can freely choose between the first mode, which provides an excellent sense of realism, the second mode, which provides a large amount of information, and the third mode, which provides a good balance between these modes. It becomes possible to select, and improve convenience.
  • the video chat system 1 includes the occupants (second occupants) of the second vehicle 10 whose chat group is different from that of the vehicle 10.
  • a second distribution means 3 for distributing peripheral images to a chat group can be provided.
  • the control means 5 of the second vehicle 10 can selectively display either the vehicle surrounding image or the second vehicle surrounding image according to an operation by the occupant, the second occupant, or the user.
  • This embodiment is provided with a generating means 4 that generates an overhead image of the vehicle 10 based on vehicle surrounding images captured by a plurality of imaging devices 18 mounted on the vehicle 10.
  • the control means 5 can display the bird's-eye view image generated by the generation means 4 on the chat screen, as shown in FIG. 6(C), for example.
  • the generating means 4 of the present embodiment is capable of synthesizing the CG image of the vehicle 10 on the bird's-eye view image based on the viewpoint and line-of-sight direction of the bird's-eye view image. .
  • the control means 5 of this embodiment can display driving information representing the driving state of the vehicle 10 on the chat screen.
  • driving information 55 such as vehicle speed and engine rotation speed is displayed superimposed on vehicle surrounding images 54 and 57.
  • the program 2 installed in the vehicle 10 and the terminal 20 is executed in cooperation with each other, but instead of such a configuration, the program 2 may be installed only in the server 30. However, this program 2 may be made to control the vehicle 10 and the terminal 20. In other words, instead of the electronic control device 11 of the vehicle 10 or the electronic control device 21 of the terminal 20, the electronic control device 31 of the server 30 may be the main control entity. At least, by providing the distribution means 3 and the control means 5 in the video chat system 1, the same functions and effects as in the above embodiment can be obtained.
  • the video chat system 1 including the terminal 10' and the terminal 20 as in-vehicle computers was illustrated, but the video chat system uses the terminal 20 owned by the occupant of the vehicle 10 instead of the terminal 10'. 1 may be constructed. That is, the computer used when the occupant of the vehicle 10 chats may be the terminal 10' mounted on the vehicle 10, or may be a terminal 20 independent from the vehicle 10, such as a smartphone.
  • a video chat system for supporting communication in a chat group including a passenger of a vehicle equipped with an on-board computer and a user who is not a passenger of the vehicle, the video chat system comprising: distribution means for distributing vehicle surrounding video captured by an imaging device mounted on the vehicle to the chat group; a control means for displaying messages exchanged within the chat group and images around the vehicle on chat screens of a terminal in the vehicle and a terminal of the user;
  • a video chat system comprising:
  • the chat screen has a first mode in which the message and the image around the vehicle are displayed simultaneously, a second mode in which the message and the map image are simultaneously displayed, and a second mode in which the message, the image around the vehicle, and the map image are simultaneously displayed. and a third mode that allows The video according to appendix 2, wherein the control means selects any one of the first mode, the second mode, and the third mode in response to an operation by the occupant or the user. chat system.
  • the video chat system wherein the chat group includes a second occupant of a second vehicle different from the vehicle, comprising a second distribution means for distributing a video around the second vehicle captured by a second imaging device mounted on the second vehicle to the chat group; Supplementary note, wherein the control means selectively displays either the vehicle surrounding image or the second vehicle surrounding image in response to an operation by the occupant, the second occupant, or the user.
  • the video chat system according to any one of 1 to 3.
  • the video chat system according to any one of appendices 1 to 4, wherein the control means displays the bird's-eye view video on the chat screen.
  • a program for supporting communication in a chat group including a passenger of a vehicle equipped with an on-board computer and a user who is not a passenger of the vehicle, the program comprising: distributing vehicle surrounding video captured by an imaging device installed in the vehicle to the chat group; A program that causes a computer to execute a process of displaying messages exchanged within the chat group and video surrounding the vehicle on chat screens of a terminal in the vehicle and a terminal of the user.
  • the chat screen has a first mode in which the message and the image around the vehicle are displayed simultaneously, a second mode in which the message and the map image are simultaneously displayed, and a second mode in which the message, the image around the vehicle, and the map image are simultaneously displayed. and a third mode that allows The program according to supplementary note 9, which causes a computer to execute a process of selecting one of the first mode, the second mode, and the third mode in response to an operation by the occupant or the user.
  • the chat group includes a second occupant of a second vehicle different from the vehicle; distributing a second vehicle surrounding image captured by a second imaging device mounted on the second vehicle to the chat group; Supplementary Notes 8 to 10, wherein the computer executes a process of selectively displaying either the vehicle surrounding image or the second vehicle surrounding image in response to an operation by the occupant, the second occupant, or the user.
  • This case can be used in the manufacturing industry and service provision business of video chat systems and programs. Furthermore, it can be used in the manufacturing industry of in-vehicle computers applied to video chat systems, the manufacturing industry of terminals (smartphones, desktop computers, notebook computers, PDAs, etc.), and the manufacturing industry of servers.
  • Video chat system Program 3 Distribution means, second distribution means 4 Generation means 5 Control means 10 Vehicle, second vehicle 10', 20 Terminal 30 Server 40 Network

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente divulgation concerne un système de dialogue en ligne vidéo (1) destiné à aider la communication dans un groupe de dialogue en ligne qui comprend : un occupant d'un véhicule (10) dans lequel un ordinateur embarqué a été installé ; et un utilisateur qui n'est pas un occupant du véhicule (10). Le système de dialogue en ligne vidéo décrit (1) comprend : un moyen de distribution (3) pour distribuer une vidéo d'environnement de véhicule capturée par un dispositif d'imagerie (18) installé dans le véhicule (10) au groupe de dialogue en ligne ; et un moyen de commande pour amener des messages échangés à l'intérieur du groupe de dialogue en ligne et la vidéo d'environnement de véhicule à être affichés sur des écrans de dialogue en ligne d'un terminal (10') à l'intérieur du véhicule (10) et d'un terminal (20) de l'utilisateur.
PCT/JP2023/026666 2022-08-08 2023-07-20 Système de dialogue en ligne vidéo et programme WO2024034350A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-126195 2022-08-08
JP2022126195 2022-08-08

Publications (1)

Publication Number Publication Date
WO2024034350A1 true WO2024034350A1 (fr) 2024-02-15

Family

ID=89851428

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/026666 WO2024034350A1 (fr) 2022-08-08 2023-07-20 Système de dialogue en ligne vidéo et programme

Country Status (1)

Country Link
WO (1) WO2024034350A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014146333A (ja) * 2013-01-28 2014-08-14 Naver Corp メッセンジャーチャットウィンドウを介したリアルタイム映像共有装置、方法およびコンピュータ読み取り可能な記録媒体
WO2015068501A1 (fr) * 2013-11-08 2015-05-14 本田技研工業株式会社 Dispositif de commande de déplacement de convoi
US20170274771A1 (en) * 2016-03-24 2017-09-28 Toyota Jidosha Kabushiki Kaisha Wireless Data Sharing Between a Mobile Client Device and a Three-Dimensional Heads-Up Display Unit

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014146333A (ja) * 2013-01-28 2014-08-14 Naver Corp メッセンジャーチャットウィンドウを介したリアルタイム映像共有装置、方法およびコンピュータ読み取り可能な記録媒体
WO2015068501A1 (fr) * 2013-11-08 2015-05-14 本田技研工業株式会社 Dispositif de commande de déplacement de convoi
US20170274771A1 (en) * 2016-03-24 2017-09-28 Toyota Jidosha Kabushiki Kaisha Wireless Data Sharing Between a Mobile Client Device and a Three-Dimensional Heads-Up Display Unit

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LOVECARS!TV!: "[Drive Live] Finally Coming Back from Fuji Speedway in a Subaru BRZ!", YOUTUBE, XP093139959, Retrieved from the Internet <URL:https://www.youtube.com/watch?v=6siIu-NIaeY> [retrieved on 20240311] *

Similar Documents

Publication Publication Date Title
EP3794851B1 (fr) Environnement partagé pour occupant de véhicule et utilisateur distant
US9616901B2 (en) Mobile object, system, and storage medium
US11410634B2 (en) Information processing apparatus, information processing method, display system, and mobile object
CN107458325A (zh) 用于在自主驾驶运载工具处提供积极信息娱乐的***
US20220068140A1 (en) Shared trip platform for multi-vehicle passenger communication
US20090289955A1 (en) Reality overlay device
US20210110596A1 (en) Information processing device, information processing method, and program
CN109387217A (zh) 导航方法、计算机可读存储介质及导航服务器
CN114201038A (zh) 在车辆乘员之间共享增强现实内容的集成增强现实***
US10232710B2 (en) Wireless data sharing between a mobile client device and a three-dimensional heads-up display unit
WO2024034350A1 (fr) Système de dialogue en ligne vidéo et programme
US20230353616A1 (en) Communication Sessions Between Devices Using Customizable Interaction Environments And Physical Location Determination
US20230386138A1 (en) Virtual environments for autonomous vehicle passengers
KR20180035452A (ko) 차량에 탑재된 인포테인먼트 시스템 및 그 구동 방법
JP2021097407A (ja) 動画配信サーバーおよび動画配信システム
US20240085976A1 (en) Information processing system
US20240105052A1 (en) Information management device, information management method and storage medium
US20240161428A1 (en) Method and system for presenting a shared virtual environment to users residing in different vehicles, and server unit, user device, and vehicle
CN117584878A (zh) 用于向用户提供沉浸式体验的方法和***
JP2006131205A (ja) 各種乗り物の内外における画像のｉ．ｔ管理システム
JP2024038605A (ja) 情報処理システム
JP2024039702A (ja) 情報処理システム
JP2024003484A (ja) リアルタイム映像配信システム
JP2024041343A (ja) 情報処理装置、情報処理システム、および情報処理方法
JP2024039763A (ja) 情報処理システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23852326

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)