CN107168666A - The system and method for USB interface-based audio video transmission and multi-screen mapping - Google Patents
The system and method for USB interface-based audio video transmission and multi-screen mapping Download PDFInfo
- Publication number
- CN107168666A CN107168666A CN201710266045.7A CN201710266045A CN107168666A CN 107168666 A CN107168666 A CN 107168666A CN 201710266045 A CN201710266045 A CN 201710266045A CN 107168666 A CN107168666 A CN 107168666A
- Authority
- CN
- China
- Prior art keywords
- usb
- video
- audio
- equipment
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses the system and method that USB interface-based audio video transmission and multi-screen map, with including from the system of mapping function:Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map, possesses the mapping device of USB Virtual File Systems, it is configured as being connected with the target end equipment by the USB interface of the Mass Storage agreements based on USB standard, the target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.System with receive capabilities includes:Source equipment, possess USB interface and/or video read the target end equipment of playing function, possess USB Virtual File Systems mapping device composition the system with reception/read functions.The system of the present invention overcomes and needs source equipment and target end equipment to be provided simultaneously with same protocol capability present in prior art or need to have the problem of HDMI could carry out screen map and limitation.
Description
Technical field
It is more particularly to USB interface-based the present invention relates to data processing and automotive electronic technology and wireless communication field
Audio video transmission and system, the method for multi-screen mapping are such as more using mobile phone, tablet personal computer, PC, TV, projecting apparatus, vehicle-mounted etc.
Screen map technology on media termination.
Background technology
The technology of screen map is referred to the screen content shown by a terminal (hereinafter referred to as source equipment), is reflected
It is mapped on another terminal (hereinafter referred to as target end equipment) screen.What interior shown by the screen in source equipment was perhaps played
Audio, can synchronize display in target end equipment and isochronous audio is played.And specifically, source equipment be often referred to mobile phone,
PC, tablet personal computer etc. mini-plant, target end equipment are often referred to vehicle mounted multimedia, TV, giant-screen PC, projecting apparatus, open air
The equipment that advertisement screen etc. carries larger screen.
Screen map is divided into duplication screen (also referred to as with screen mapping) and extended screen (also referred to as split screen mapping) again.With screen
Mapping refers to that the content that source equipment is shown is identical with the content that target end equipment is shown.Split screen mapping refers to destination end
Equipment equivalent to source equipment another screen, so show the interface of some application program on source screen, and target
The interface of another application program of the screen display source equipment of end equipment.Application program includes answering for common information displaying
With program, also comprising audio/video player etc. application program.
The technology of current screen map, never ipsilateral classified description is as follows:
1) various general common VNC (Virtual Network Console, virtual network controls platform) technologies, specifically
For be between the source device and destination end of phase internet intercommunication, to set up data cube computation, pass through various VNC communications protocol, will
The information such as screen, sound and the touch-control of source equipment, are mapped in the equipment of destination end, and the equipment of destination end can see source
The screen display of equipment, the sound of broadcast source end equipment, and application program touch-control of source equipment etc. can be manipulated.Typical generation
Table is Windows Remote desk process, the PC screen operators of Android mobile phone etc..
2) it is used for vehicle-mounted or related television equipment screen map technology, such as, MirrorLinkTMStandard,
MiracastTMTechnology, WIDITMTechnology, the Carplay of Apple Apple Inc.TM, the leading Google Auto of Google companiesTM
Technology etc., the purpose of these technologies is all to pass through formulated codes and standards, mobile phone can be allowed with in-vehicle multi-media system or
TV (abbreviation vehicle device) is interconnected, it is possible to realize the mobile phone and the double-direction control of vehicle device/TV to application specific software, mesh
Mark is to make user in vehicle traveling process without the screen that sees the mobile phone, and touches mobile phone screen or operating handset button.Such as,
MirrorLink standards combine a variety of prior arts and use situation to meet various possible in-cars, including are transported with virtual network
Calculate (VNC) carry out picture show with user instruction input, through UPnP (Universal Plug and Play,
UPnPTM) look for corresponding equipment and complete correct setting configuration, with bluetooth (BluetoothTM) and RTP
(Real-Time Protocol, RTP) performs audio stream etc., MirrorLinkTMAlso it can support to be commonly used in the car at present
Specification include the technologies such as bluetooth HFP and A2DP agreements.Miracast equipment provides to simplify and finds and set, and user can be rapid
Video is transmitted in equipment room.Again such as, Miracast user can browse the photograph that smart mobile phone takes on large-size screen monitors TV heartily
Piece, by conference room projectors Real-Time Sharing notebook screens, or watches on tablet personal computer the straight of home videos set top box
Broadcast program.Miracast passes through Wi-Fi CERTIFIED Wi-Fi DirectTMConnection is formed, therefore any Wi- need not be accessed
Fi networks --- possess linkage function inside Miracast authenticating devices.Again such as, WiDi (Intel Wireless
Display) full name is WirelessHD technology, and it is the wireless connection that computer and display device are realized by WiFi signal.
WiDi realization principle is that notebook sends wireless signal by wireless network card first, and then television has a wireless receiving
Device receives WiFi signal, and radio receiver is transferred to signal on display device by HDMI or A/V cables.Again
Such as, AirPlaytmIt is a kind of play-back technology of Apple Inc., can be by regarding on iPhone, iPod touch, iPad and Mac
Frequency mirror image is sent to support AirplaytmEquipment (such as:Audio amplifier, Apple TV, vehicle device) middle broadcasting.
Again such as, Google AutoTMTechnology be Google companies release be mapped to vehicle device screen for Android mobile phone
Scheme.
3) from the point of view of physics external expressive form, the terminal that built-in mapping receives agreement, and external HDMI can be divided into
Dongle (also referred to as HDMI rods) mapping reception mode, wherein, built-in mapping receives the target terminal of agreement, before terminal is dispatched from the factory
Through the built-in agreement of some above-mentioned screen map, the mapping request to receive the agreement.External HDMI Dongle are then
Using the device of above-mentioned a certain agreement, by HDMI display interfaces, target terminal equipment is connected to, to obtain the energy of screen map
Power.
Although the mapping needs for meeting various terminal equipment to a certain extent of above prior art.But various agreements are mutual
Incompatible, usual target terminal can only receive the mapping request of some source terminal for planting mapped specific agreement.In addition, realizing this
The scheme of kind needs a precondition:Target end equipment needs preset this agreement before dispatching from the factory.Some other agreements can't be propped up
Audio transmission is held, can only be aided in by way of bluetooth, such as MirrorLink.Above the first two subject matter constrains screen
The application of curtain mapping so that the target terminal equipment of most of giant-screen does not possess screen map ability.
As for external HDMI Dongle form, above-mentioned described target terminal is solved to a certain extent dispatching from the factory needs
Want it is preset wirelessly map agreement the problem of.But another problem is brought, need target terminal to possess HDMI
Ability.But most of existing terminal device, including vehicle device, TV, projection, outdoor advertising etc. do not possess HDMI interface.
Therefore, mapping function can not be applied in these occasions.In addition, because HDMI itself does not possess enough power supply energy
Power, in addition it is also necessary to which external power supply is powered, allows HDMI application to be restricted.
In the prior art, there are some methods solved, such as the A of patent announcement CN 104142806, vehicle carried mobile phone interconnection
System, including intelligent mobile phone terminal and onboard system, the onboard system include:Microprocessor and with the microprocessor
Power management module, audio-video collection module, audio frequency and video processing module, bluetooth module, WIFI module and the audio frequency and video of electrical connection
Output module, the intelligent mobile phone terminal is connected by bluetooth module or WIFI module with onboard system wireless telecommunications, the sound
Video Output Modules electrically connect vehicle headrest liquid crystal display.Intelligent mobile phone terminal and vehicle-mounted system are realized using wireless communication technique
Wireless interaction control between system, undistorted, high definition can be synchronized to vehicle headrest by the content of multimedia in intelligent mobile phone terminal
Played on liquid crystal display, visual effect can be effectively improved.But have the disadvantage that:The terminal belongs to the end of built-in shadowing agreement
Mobile phone, and is attached by end by the way of USB is wired with vehicle-mounted, and is not suitable for the terminal that does not possess built-in shadowing agreement
Application scenarios.Again such as, Chinese patent application CN201420476148.8, automobile entertainment audio-visual devices are mutually contacted with mobile phone
System, including automobile entertainment audio-visual devices and smart mobile phone, the automobile entertainment audio-visual devices have general-purpose serial bus USB interface
Receiving unit, the smart mobile phone has a transmitting element of the USB interface, the receiving unit of the USB interface and described
The transmitting element of USB interface is connected by wired mode.The utility model not only realizes two-screen Interactive, can also give smart mobile phone
Battery charges, and enhances the endurance of smart mobile phone.But have the disadvantage that:The terminal belongs to the terminal of built-in shadowing agreement,
By the way of USB is wired by mobile phone and it is vehicle-mounted be attached, the same terminal for not being suitable for not possessing built-in shadowing agreement
Application scenarios.Again such as, the U of patent announcement CN 205657799, a kind of wireless audio and video emitter of USB interface, institute
Stating wireless audio and video emitter includes PC ends and dongle ends, and the PC ends are connected to dongle ends by USB interface.It is described
PC ends include the video acquisition unit for gathering video information and the audio collection unit for gathering audio-frequency information, described to regard
Frequency collecting unit includes capture mouse module, capture screen module, screen scaling processing module and video encoding module, described to regard
Frequency collecting unit and audio collection unit are connected to USB interface.The dongle ends include central processing module, the centre
Reason module is connected with WiFi module, key-press status detection monitoring modular and LED for launching video information and audio-frequency information
Display module.But have the disadvantage that:The terminal belongs to source device terminal, and is gathered by the USB newly increased a Dongle
The video and audio of source terminal, belong to and are connected to source dispensing device, but can not be received as the USB for being connected to target terminal
Device, in addition this patent need to target end equipment related software will be installed in source equipment, it is pointed out that simultaneously
It is not that each target end equipment possesses software installation ability.Patent publication No CN104539707A, vehicle device, mobile phone and PC ends
Screen map method and system, vehicle device wirelessly transmits data and control with mobile phone, and vehicle device passes through nothing with server
The mode of line transmits data and control, and server is connected with PC ends, but had the disadvantage that:Terminal with built-in shadowing agreement,
And by the way of USB is wired by mobile phone and it is vehicle-mounted be attached, the same end for not being suitable for not possessing built-in shadowing agreement
The application scenarios at end.
The content of the invention
The technical problem to be solved in the present invention is to provide one kind so that any possess USB interface and USB video playback capabilities
Target end equipment possess screen map and broadcast source end equipment audio frequency and video ability USB interface-based audio video transmission and
The system of multi-screen mapping, so as to overcome source equipment and target end equipment the need for presence to be in the prior art provided simultaneously with same association
View ability or need to have HDMI could carry out screen map or need simultaneously two ends install software the problem of and
Limitation.
Above-mentioned technical problem is solved, the invention provides the system that USB interface-based audio video transmission and multi-screen map,
Including:
Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map,
Possess the mapping device of USB Virtual File Systems, be configured as by the Mass Storage associations based on USB standard
The USB interface of view is connected with the target end equipment, and the target end equipment is obtained by accessing the USB Virtual File Systems
The data of dynamic generation.
Present invention also offers the system that USB interface-based audio video transmission and multi-screen map, it is characterised in that bag
Include:
Source equipment, to the device as screen map,
Possess USB interface and/or video reads the target end equipment of playing function, to the screen as the source equipment
Curtain or the carrier of audio frequency and video mapping,
Possess the mapping device of USB Virtual File Systems, be configured as connecting by USB interface and the target end equipment
Connect,
The target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.
Based on above-mentioned, the mapping device in the present invention is specifically included:One virtual USB disk file system module and a sound are regarded
Frequency stream synthetic video file format coding module,
The virtual USB disk file system module, for producing a Virtual File System on USB interface,
The audio/video flow synthetic video file format coding module, for being carried for above-mentioned virtual USB disk file system module
For the file content asked, when the virtual USB disk file system module accesses the content of file by USB, and by sound
Video Composition is the related pattern data flow of Virtual File System, exports and gives virtual USB disk file system module.
Based on above-mentioned, the system in the present invention also includes:Video compressing module, audio compression module, audio/video coding mould
Block, default file interface processing module,
The video compressing module, to be stored in audio/video coding module after video original data is compressed,
The audio compression module, to be stored in audio/video coding module after audio raw data is compressed,
The audio/video coding module, audio/video coding is synthesized into setting formatted data stream,
The audio/video coding module is connected with audio/video flow synthetic video file format coding module,
The default file interface processing module, to obtain file directory or data locally or remotely, and is completed
Corresponding adaptation is operated.
Based on above-mentioned, the system in the present invention also includes:One touch signal transferring device, to by the target end equipment
Touching signals the mapping device is sent to by touching signals forwarding interface, and source equipment is passed back to by mapping device
On by call touch-controlling interface complete touch control operation.
Based on above-mentioned, the system in the present invention also includes:One remote control equipment, for the mapping device by bluetooth or
Person WI-FI is connected, and carries out touching/the straighforward operation of button.
Further, a player media list is generated in the target end equipment, in each source equipment
After registration on the player media list correspondence, produce supporting virtual file and corresponding document data.
Further, the source equipment is wirelessly transferred by WI-FI is connected with mapping device, the mapping device.
Walked the invention provides what USB interface-based audio video transmission and multi-screen mapped from mapping method, including as follows
Suddenly:
S1 will be provided with USB interface and/or video and read the target end equipment of playing function as the carrier of screen map,
The mapping device that S2 will be provided with USB Virtual File Systems is configured to by the Mass Storage based on USB standard
The USB interface of agreement is connected with the target end equipment, and the target end equipment is obtained by accessing the USB Virtual File Systems
Take the data of dynamic generation.
The method that USB interface-based audio video transmission and multi-screen mapping are additionally provided in the present invention, comprises the following steps:
S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, and mapping device works on power,
And wait other source devices to connect, while the USB interface in the mapping device simulates one based on Mass Storage agreements
USB Virtual File Systems,
S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, passes through the company of authentication
Connect mapping device,
S3 is by after the source equipment and the mapping device successful connection, the USB virtual files in the mapping device
System will generate corresponding Virtual File System catalogue and listed files structure according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the S4 in target end equipment is played out
Beneficial effects of the present invention:
The substantial amounts of target end equipment based on USB player is caused using the present invention, possessed another source equipment
Ability of the screen map in target end equipment, it is achieved thereby that the effect that target end equipment display capabilities are fully used, and
Save discarded and transformation the sky high cost of equipment.
Brief description of the drawings
Fig. 1 is the system structure diagram of the present invention (from mapping);
Fig. 2 is the system structure diagram (receive capabilities) of the present invention;
Fig. 3 is the schematic diagram of the mapping device of the USB virtual files of itself mapping;
Fig. 4 is the schematic diagram of the mapping device with receive capabilities USB virtual files;
Fig. 5 is physico connection diagram;
Fig. 6 is a preferred embodiment schematic diagram of mapping device;
Fig. 7 is source apparatus logic schematic diagram;
Fig. 8 is reception device logic flow schematic diagram;
Fig. 9 is destination end apparatus logic and schematic flow sheet;
Figure 10 is player media list schematic diagram in target end equipment.
Embodiment
The principle of the disclosure is described referring now to some example embodiments.It is appreciated that these embodiments are merely for saying
It is bright and help it will be understood by those skilled in the art that with the purpose of the embodiment disclosure and describe, rather than advise model of this disclosure
Any limitation enclosed.Content of this disclosure described here can be implemented in the various modes outside mode described below.
As described herein, term " comprising " and its various variants are construed as open-ended term, it means that " bag
Include but be not limited to ".Term "based" is construed as " being based at least partially on ".Term " one embodiment " it is understood that
For " at least one embodiment ".Term " another embodiment " is construed as " at least one other embodiment ".
It refer to the system structure diagram (from map) that Fig. 1 is the present invention, USB interface-based audio video transmission and many
Shield the system of mapping, including:Possess USB interface and/or video reads the target end equipment 300 of playing function, to be used as screen
The carrier of curtain mapping, possesses the mapping device 200 of USB Virtual File Systems, is configured as by the Mass based on USB standard
The USB interface of Storage agreements is connected with the target end equipment, and the target end equipment is virtually literary by accessing the USB
Part system obtains the data of dynamic generation.Mapping device 200 in the present embodiment has been running for a set of operating system in itself
(such as, Android operation system, in addition, mapping device in itself can be without screen display, can be with screen display), then mapping is filled
The interface by USB Virtual File Systems is put, the operation system interface of mapping device in itself is mapped in target end equipment.
In the case of there is no screen display, using the remote control (optional) described in the present embodiment, mobile phone or special distant is used
Equipment is controlled to operate the operation system interface of mapping device in itself.In the present embodiment, mapping device 200 itself in fact
It is also the effect as source equipment.
Refer to Fig. 2 be the present invention system structure diagram (receive capabilities), USB interface-based audio video transmission and
The system of multi-screen mapping, including:Source equipment 100, to the device as screen map, possesses USB interface and/or video is read
The target end equipment 300 of playing function is taken, the carrier mapped to the screen as the source equipment or audio frequency and video possesses
The mapping device 200 of USB Virtual File Systems, is configured as being connected with the target end equipment by USB interface, the target
End equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.Using the present embodiment methods described and dress
Put, compared with prior art, achieve the progress that screen map is extended to general-purpose capability so that substantial amounts of only fixing function
Target end equipment with giant-screen and USB player possesses the energy by the screen map of another source equipment in this equipment
Power, has reached the effect that target end equipment display capabilities are fully used, and saves discarded and transformation the sky high cost of equipment, very
To the ability for making these giant-screens possess smart machine.
As shown in fig. 6, system is divided into USB Virtual File Systems software subsystem and audio/video flow processing subsystem, wherein
USB Virtual File System software subsystems include virtual USB disk file system module and audio/video flow synthetic video file format
Coding module, wherein audio/video flow processing subsystem include video compressing module, audio compression module, audio/video coding module,
Alternative document interface processing module.
Above-mentioned related system module composition is as follows:
Virtual USB disk file system module 2002, for producing a Virtual File System on USB interface.See outside
Equipment be a USB flash disk equipment, may browse through catalogue and read file.
Audio/video flow synthetic video file format coding module 2001, for providing institute for virtual USB disk file system module
The file content of request.When USB accesses the content of some file, the book of audio frequency and video is synthesized to the correlation of Virtual File System
Formatted data stream, exports and gives virtual USB disk file system module.
Video compressing module, video original data is compressed, and is reduced transmitting data stream, is used for coding module.
Audio compression module, audio raw data is compressed, and reduces transmitting data stream.Used for coding module.
Audio/video coding module, by audio/video coding synthesize H.264 or MPEG4 etc. form data flow.
Alternative document (default) interface processing module:The catalogue and data of file system locally or remotely are obtained, and
Make corresponding adaptation and operate.These data are used for virtual USB disk file system module (026).
Basic skills is described as follows:Display screen data stream is the data flow that shows the need for locally or remotely.Display
On-screen data stream can be the data flow for the screen content or video playback being currently displaying.Audio stream is ibid.This
A little data flows can be broadcast after video compress and audio compression carry out audiovisual compression, then by the generation of audio/video coding module
The video flowing put, then audio/video flow synthetic video file format coding module by these file synthesis be U disk file system in
File content, virtual USB disk file system management document directory structure and file read-write operations, please when accessing file content
Audio/video flow synthetic video file format coding module is asked to obtain the content of file.
Purpose in the present embodiment is user is mapped to the small screen (or audio-video document) of source equipment 100
Screen shows and audio and video playing are carried out on the giant-screen of target end equipment 300.
Mapping device 200 in the present embodiment is a small-sized equipment, and target end equipment is inserted into by USB interface
On 300 USB interface, target end equipment 300 need to possess USB flash disk reading capability and play the ability of USB flash disk audio frequency and video.Source equipment
100 with mapping device 200 by communicating, receive displaying information on screen that mapping device 200 sends source equipment 100 and
Audio/video information, synthesizes the audio and video playing file of correlation, and with the USB interface of target end equipment 300, fictionalizing text
Part system and audio/video multimedia played file, such target end equipment 300 just can be in the feelings changed without any software and hardware
Under condition, the screen message of displaying source equipment 100 or the audio frequency and video of broadcast source end equipment 100.When be operated in itself mapping
Situation, mapping device 200 also serves as source equipment 100 using there is provided the data shown needed for its own system screen and sound simultaneously
Frequency according to etc..Specific to the implementation method from mapping, following steps are specifically included:
Step S1 will be provided with USB interface and/or video and read the target end equipment of playing function being used as the load of screen map
Body,
The mapping device that step S2 will be provided with USB Virtual File Systems is configured to by the Mass based on USB standard
The USB interface of Storage agreements is connected with the target end equipment, and the target end equipment is virtually literary by accessing the USB
Part system obtains the data of dynamic generation.
From above-mentioned Fig. 1 or Fig. 2, by creating a void on the USB interface on existing device or newly added equipment
Intend file system.This file system is not the real file system in the equipment, but the dependency structure in internal memory and
Data.Method dynamic generation described by the data this patent of file.Target end equipment is by accessing the text of this virtual file
Part, reaches the data for accessing these dynamic generations.Concrete application field is to pass through the data flow and audio stream of screen display
Related step is converted into file stream, is conducted interviews for target end equipment by the file system of standard.
It is the schematic diagram of the mapping device with receive capabilities USB virtual files as shown in Figure 4, including:
Source equipment 100, refers to the equipment for needing to carry out screen map, is often referred to mobile phone, tablet personal computer, PC etc. small
Type equipment.Needed in source equipment install the present embodiment in source software, using source equipment 100 itself WIFI or
USB is communicated with reception device (200).Further, if source equipment 100 compatible can be reflected with the application
Agreement is penetrated, can be identified by other shadowing agreement processing modules, then the source software system of this patent need not can also be installed
System can also be attached with the mapping device 200 in the present embodiment, and complete the function of screen map and multimedia.
Target end equipment 300, is referred in the equipment that is mapped to the screen and audio frequency and video of source device, typically with larger
Display screen.It is often referred to vehicle-mounted multimedia equipment, large-size screen monitors TV, PC computers, projector equipment, outdoor advertisement screen, industrial control equipment
Screen etc..If without the passback of touch signal, without being made any change to target end equipment 300 in the present embodiment
(including software and hardware), target end equipment 300 keeps original state.Further, if necessary to enter in target end equipment 300
Row touch-control etc. is operated, then can add touch signal transferring device 400.
Mapping device 200, mapping device 200 is attached using USB external interfaces with target end equipment 300, mapping dress
It is virtually a USB flash disk (by the Mass Storage agreements of USB standard), target end equipment 300 that 200, which are put, by this USB interface
Read according to the form of USB flash disk.The file of USB flash disk is then the video file of the pre-configured resolution ratio of correspondence.In mapping device 200
The reception device software systems in the equipment such as CPU and WIFI/USB and interface, the present embodiment are put by using WIFI or USB etc.
Method, is received after the information such as screen/video/audio of source equipment 100, information is converted and synthesized above-mentioned meets USB
The video file of Mass Storage protocol interfaces, the multimedia play system of such target end equipment itself just can be according to just
Normal multimedia file carries out the broadcasting of audio frequency and video, and is shown on the display screen of destination end, so reach by.Further
, if the simply mapping in terms of audio, it is converted into the audio file formats that target end equipment 300 can be recognized, so, mesh
Mark end equipment 300 can carry out the transmission of audio by way of playing audio file.Such equipment can have two kinds of systems
Implementation, that is, system (see Fig. 3) and conduct reception work(as the USB Virtual File System mapping devices itself mapped
The system of the USB Virtual File System mapping devices of energy (see Fig. 4).Further, both systems can have one simultaneously
In device, that is, it is provided simultaneously with itself mapping and receives the function of outside mapping.When the situation for being operated in itself mapping, mapping
Device 200 also serves as source equipment 100 using there is provided the data shown needed for its own system screen and voice data etc. simultaneously.
As shown in figure 4, in the present embodiment, also being wrapped in the system of USB interface-based audio video transmission and multi-screen mapping
Include:One touch signal transferring device 400, the touching signals of the target end equipment to be sent out by touching signals forwarding interface
The mapping device is sent to, and is passed back to by mapping device in source equipment by calling touch-controlling interface to complete touch control operation.
Touch signal transferring device as can screening device, in general, man-machine interactive operation can be completed in source equipment 100, because
For the relation of screen map, destination end can show the result of man-machine interaction.Some situations, if necessary to directly be set in destination end
Standby 300 carry out human-machine operation, then by transforming the touching signals that hardware platform is exported in target end equipment 300, are set with destination end
Touch signal transferring device between standby 300 touch screen in access the present embodiment.Touch signal transferring device sets destination end
Standby 300 touching signals are sent to mapping device 200 by touching signals forwarding interface, and are passed back to by mapping device 200
On source software, and call the operating system touch-controlling interface of source equipment to be called by source software (1011), complete touch-control
Operation.Further, if there was only the touch-control on display screen, display screen without man-machine interaction by target end equipment 300
Screen, but needs touch controllable function again, then needs in target end equipment 300, newly increases a Touch Screen, and by touching signals
Being connected to the touch signal transferring device of this patent can achieve the goal.
As shown in Fig. 4 or Fig. 3, in the present embodiment, system also includes:One remote control equipment, for the mapping device
It is connected by bluetooth or WI-FI, touch/the straighforward operation of button.
The remote control equipment 500, is the optional equipment in the present embodiment.For the behaviour being remotely controlled with mapping device 200
Make.When the inconvenient touch sources end equipment 100 of user, it can be replaced during target end equipment 300 using remote control equipment 500.Especially
If being the system in use, do not have simultaneously of the USB Virtual File System mapping devices mapped in mapping device 200 as itself
There is the display device of correlation, when being also not desired to increase above-mentioned touch signal transferring device 400, then touch can be used as using this equipment
The need for operation and button operation.Software system function on remote control equipment 500, can together with this source Integrated Simulation,
The function of remote control equipment 500 is realized on a mobile phone or tablet personal computer.
Alternatively, the target terminal equipment 300 in the present embodiment is changed without any, it is only necessary to inserted in the present embodiment
It is the purpose that can reach screen map and audio and video playing to receive mapping device 200.Because further, if user needs
Also can be if synchronous touch control operation, it is necessary to the device of this touching signals be added, for forwarding target terminal in target terminal equipment
The touch information of equipment.Further, if the key information of target terminal equipment 300 will also be fed back into source equipment
In 100 operation.It is also that signal collection and forwarding are carried out by the present apparatus.Concrete implementation mode is, whole by intercepting target
The hardware connection signal of main frame and touch-screen in end equipment, this device is transparent for the main frame and touch-screen of target terminal
, because the present apparatus is intact to pass to main frame and touch-screen by signal before.Meanwhile, it will pass through after the decoding of signal
The newly-increased touch signal transmission interface of this patent, this interface can be serial interface or USB interface, reciprocity to receive dress
The touch signal receiving interface for putting 200 is corresponding and dock the transmission of laggard row information.By the touch-control of target end equipment (touch and
The information of actuation of keys) pass back to source equipment and handled.
Alternatively, the remote control 500 in the present embodiment, the implementation of remote control can be with a variety of, such as using indigo plant
The press key equipment of tooth, by the way that key information is passed into mapping device 200 with device 500, realizes button man-machine interaction.It can also lead to
Cross and remote control end software is installed on mobile phone or tablet personal computer, by way of WIFI/ bluetooths, realize long-range man-machine interaction control
System.
Deploy description by taking the system as the USB Virtual File System mapping devices of receive capabilities as an example below:
Generally speaking include for example following implementation:
Step S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, electrician on mapping device
Make, and wait other source devices to connect, while the USB interface in the mapping device simulates one based on Mass Storage associations
The USB Virtual File Systems of view,
Step S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, passes through mirror
Power connection mapping device,
Step S3 is by after the source equipment and the mapping device successful connection, and the USB in the mapping device is virtual
File system will generate corresponding Virtual File System catalogue and listed files structure according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the step S4 in target end equipment is carried out
Play
Specifically,
The first step:When mapping device 200 is inserted into the USB interface of target end equipment 300 by USB interface, mapping dress
Put 200 to work on power, and wait the connection of each source device.At the same time, mapping device 200 simulates one in USB interface
Meet Mass Storage agreements (note:Mass Storage are the parts in usb protocol, are mass storage or sea
Measure the meaning of memory.This protocol development and make that USB flash disk is utilized.This agreement is deferred to, USB Slave can be allowed
Equipment (slave unit) is connected in USB Host equipment (main equipment), and is able to carry out the transmission (storage and read-write etc.) of file.
General operating system is all integrated with the driving of this agreement, so when the storage device such as USB flash disk is inserted on PC/ target terminals,
Just without install drive) U disk file system.Target end equipment 300 can connect as the mode reading USB flash disk to access USB
File system on mouth.Further, if at this time also none of source equipment 100 is accessed, but destination end is set
Standby 300 have been started up the multimedia file play operation of USB interface, and mapping device 200 can fictionalize the data of video, this number
According to that can be one section of advertisement or the operation instruction introduction of one section of this patent etc., until active end equipment 100 is accessed, it will be switched to
The screen map of the source equipment 100 or the broadcasting of audio frequency and video.
Second step:Source equipment 100 is started after source software, passes through WIFI P2P Discovey (the point-to-point hairs of WIFI
Existing mechanism) to search the WIFI equipment that periphery is adapted to, pass through and authenticate connection mapping device 200.Further, mapping device 200
Upper equipment finds that to device management module related signal message to be connected can be sent, once the successful connection of source equipment 100
Afterwards, equipment is found and device management module has connected management and monitoring that equipment carries out state to these.
3rd step as shown in Figure 9:After source equipment 100 and the successful connection of mapping device 200, the void in mapping device 200
Corresponding Virtual File System catalogue and file will be generated according to the relevant information of source equipment 100 by intending U disk file system module
List structure.So, in target end equipment 300, itself possess USB audio/video player, pass through the multimedia text of its own
Part reads the catalogue and listed files of interface to read this Virtual File System etc..The manifestation mode of listed files such as Fig. 9
It is shown.Source equipment 100 can have it is multiple be registered on mapping device 200, often register a source equipment 100, just produce one
The supporting virtual file and corresponding document of set.First source device is for example have registered, is had in list to that there should be access
Device A, its lower second-level directory has the mapping video file of the screen resolution of correlation, e.g., SD format screen mapping (640*
480), its implication is:Screen or video in source equipment 100 is synthesized point of (640*480) by reception device (200)
The video file of resolution, is played out in target end equipment 300 with (640*480).Other resolution ratio are similarly.Further,
The video and audio of different coded formats can also be synthesized, to meet the audio/video encoding/decoding ability of target end equipment 300.Enter
One step, source software can also be by the list of the access device A of source equipment 100 Voice & Videos possessed etc. file
It is virtual in this document system, formed " catalogue of access device A media files ", have these listed files under catalogue.Destination end
Audio/video player in equipment 300 can be played out.Further, source software can also be by source equipment 100
Alternative document, for example, document files etc. is mapped in the virtual USB disk described in this patent, target end equipment can be opened, repaiied
Change, increase and delete etc. operation, effect is inserted into target end equipment 300 just as source equipment 100 is become into a USB flash disk
Equivalent effect.
Further, source software can also be related from Network Capture by the network-connectivity of source equipment 100
Audio and video resources, formed multimedia list, can also can so be carried out in the audio/video player in target end equipment 300
The operation such as broadcasting.Further, these files are not limited to multimedia file, and alternative document Format Type can also use this
Individual method.
4th step:Audio/video player of the user in target end equipment 300, have selected some text in above-mentioned list
The playing process of part is as follows:
First map the video file playing process of (640*480) to describe source with SD format screen below as shown in Figure 10
Cooperating process between end equipment 100, mapping device 200 and target end equipment 300.
User clicks SD format screen mapping (640*480) file in destination end device plays device and played out, mesh
The multimedia file marked in end equipment player meeting invocation target end equipment 300 reads interface, passes through the behaviour of target terminal equipment
Make the USB Mass Storage agreements of system, access USB interface, and USB interface is connected with mapping device 200 in USB interface
Connect, and pass through USB Mass Storage protocols.The corresponding correlation of the virtual USB disk file system module of mapping device 200
File content read requests, take out file content, response target end equipment 300 at video flowing synthetic video said shank module
File request.
At the same time, source equipment 100 uses display data on the screen acquisition module, gets the screen of source equipment 100
Display data, while getting the audio played data of source equipment 100 by audio acquisition module, both are respectively through video
Compression and audio compression module, enter audio/video coding module and carry out overall audio/video flow coding, audio/video flow Qos modules
(note:Qos refers to transmission quality management) for the situation, source equipment 100 and target end equipment 300 according to WIFI wireless networks
The quality of the specific encoding stream of capability negotiation, the problem of for solving frame losing and video flowing interim card.Above-mentioned video flowing is further passed through
Cross this patent protocol data processing module and be packaged into corresponding packet, be transmitted from WIFI interface.Further, or
Person can also carry out wired connection using USB interface, can improve the speed and stability of connection.But sacrificed using USB interface
The mobility of source equipment 100.
Mapping device 200 in the present embodiment from by reception device hardware system, operating system and software systems, from
WIFI interface receives video stream data produced by above-mentioned source equipment, according to related agreement, is handled.
Processing procedure of the video flowing in mapping device 200 is described below.Protocol data processing module passes through WIFI moulds
The cooperation of block and WIFI interface is got after audio and video data streams, and unpacking module into agreement obtains audio/video flow packet, so
The coding module of audio/video flow synthetic video file format, from the receiving queue of audio/video flow packet, gets data afterwards, and
By the file data that Data Synthesis is virtual file, used when reading file content for virtual USB disk file system module.
Further, if source equipment 100 possesses other shadowing agreements beyond this patent, this patent is reflected by other
Penetrate protocol process module to parse the audio, video data bag of the shadowing agreement, then encode synthesis module using video file format
It is the file content form required by virtual USB disk file system by audio/video flow Data Synthesis, completes 300 pairs of target end equipment and regard
The broadcasting read requests of frequency file content.
Further, if needing the demand of touch-control effect on the display screen of target end equipment 300, believed by touching
Number receiving interface is received from the touch data come transmitted by touch signal transferring device 400, warp with touching signals transmission interface
Touch-control coding/decoding module is crossed, returning module by touch-control passes back to the data of touch-control at source equipment 100 by WIFI interface,
The source software of source equipment 100 is received after signal, carries out the operation of touch-control, and the operation of touch-control, which will react, currently to be mapped
In the application program of screen.Operating result by the above-mentioned mapping method of this patent further be shown in target end equipment
On 300.
It is and above-mentioned described the same as the situation of the system of the USB Virtual File System mapping devices itself mapped, it is logical
" itself mapping " software subsystem is crossed to realize.Itself mapping software subsystem obtains the screen display number of equipment with source software
As being according to the function with voice data, what is obtained naturally is that mapping device 200 is locally displayed and audio in the present embodiment
Data, because these data are obtained in this patent mapping device 200, are needed not move through above as reception device
System so needs the process by WIFI or USB transmission.But enter directly into audio/video flow synthetic video file format
Coding module and virtual USB disk file system resume module.So related flow is in addition to above-mentioned difference, other are all identical
Or it is similar, no longer it is discussed in detail.
This mapping device 200 is a hardware platform contained and the device or equipment of a whole set of software systems, such as Fig. 7 institutes
Show.
The composition of hardware system in the present embodiment mainly includes following several main modulars:CPU central processing modules, it is interior
Storing module, memory module, audio/video encoding/decoding module, WIFI hardware modules, USB hardware module, serial ports hardware module.
Wherein cpu central processing unit can use ARMTMThe CPU processor of core, it would however also be possible to employ MIPSTMFramework etc.
Other processors are, it is necessary to which the substantially disposal ability met is:>300MHz instruction processing speed.It can be integrated with processor
Audio/video encoding/decoding module, integrated processor IC can preferably solve a large amount of calculating of audio/video encoding/decoding, reach optimization meter
Calculate and optimize the target of power consumption.Cpu central processing unit is arithmetic core and control core.Its function is mainly parsing and performed
Data in instruction and processing computer software, and bus is provided for control data and state, and control input/output
(I/O)。
Cpu central processing unit connects memory modules by memory interface and EBI, and memory module constitutes basic operation
System.Reception device software systems are stored in memory module, will be read during operation in memory modules, and software is performed by instruction
The flow of system.
Cpu central processing unit by peripheral bus connect WIFI hardware modules, USB hardware module serial ports hardware module, and
These modules are operated according to corresponding agreement.
WIFI module is made up of WIFI antennas, WIFI BBPs, WIFI protocol processing units and external interface.With
In standard defined in WIFI of realizing.Such as 802.11a/b/c/n.Suitable WIFI chips are can select, pass through the antenna of matching
And radio frequency parameter, meet the transmission rate of standard defined in above-mentioned WIFI and being wirelessly transferred for WIFI can be achieved.Because this is specially
The transmission for the audio frequency and video that profit is related to, so depending on transmission rate is according to the demand of resolution ratio, at least to reach 802.11b's
2Mbit/s speed.The external interface of WIFI module is typically entered using EBIs such as SDIO or USB with cpu central processing unit
Row communicates to meet above-mentioned rate requirement.Current many WIFI modules are provided in an integrated fashion, are integrated with antenna and base
Band and external interface etc..
USB hardware module needs to realize in USB Slave as defined in usb protocol (USB slave units) function, this sampling device
Operating system and software systems can carry out USB interface the operation of Virtual File System.Further, if desired by source
Equipment 100 carries out wired connection with this patent reception device, then USB hardware module needs to increase another USB hardware interface newly,
And USB Host (USB main equipment) protocol function (also referred to as OTG, On-The-Go) is realized on this interface, for receiving source
The USB wired connections request of end equipment 100.
Serial ports hardware module, for being attached and communicating with touching signals transferring device 400 by serial interface, simultaneously
Also serve as the debugging interface of this patent reception device.
Further, CPU and total solution need to select the few scheme of power consumption, because this reception device is not extra
Power supply power, the power supply capacity provided by USB interface.If USB interface use USB 2.0 interface power supply capacity for
500mA, if being 1A using the power supply capacity of the interfaces of USB 3.0.
As shown in figure 8, the software composition of mapping device 200 is divided into two large divisions, it is that the upper of reception device is run respectively
Operating system and reception device software systems:
Operating system is mainly used in CPU scheduling and the management to above-mentioned hardware module, while also needing to include to WIFI
The disposal ability of the upper layer application interface of the agreements such as agreement, usb protocol, serial port protocol.Can be using currently a popular embedded
(SuSE) Linux OS or Wince etc. operating system, as long as above-mentioned purpose can be reached and can carry soft during this is specially applied
The operating system of part system.
The software systems of mapping device 200 be provided based on above-mentioned hardware system and operating system bottom ability,
A whole set of application program that interface capability etc. is realized, for realizing the concrete function described in this patent.
The software systems of mapping device 200 include following software module:
Equipment discovery and device management module,
Protocol data processing module,
Agreement unpacks module,
Audio frequency and video synthetic video file format coding module,
Audio/video flow Qos management modules,
Virtual USB disk file system module,
Other shadowing agreement processing modules,
Touch-control coding/decoding module,
Touch-control returns module.
As described above, because software systems are based on some operating system, software systems are in different operations
System has different implementation methods, specifically needs interface and corresponding programming language and program according to defined in operating system
Framework is realized.
Below by taking the implementation that Linux operates system as an example, illustrate implementing for above-mentioned software module.
Equipment is found and device management module:By calling the interface of WIFI module, achieve a butt joint into mapping device 200
Equipment state and connection be managed, and the notification communication protocol data processing module access device state (as access,
Disconnect etc.).WIFI signal is sent by the timing of WIFI module interface in the pre-connection, source equipment 100 can be searched out and reflects
Injection device 200, and manage the process of connection.It can be by calling the interface progress pair of WIFI PnP discovery features in Linux
Outer broadcast.
Protocol data processing module upon establishment of a connection, carries out the transmission of data, source device end is to transmission
Data carry out protocol packing, and the audio frequency and video number that reverse data unpacking process obtains correlation is carried out by communications protocol processing module
According to.Communications protocol can be with a kind of self-defined encapsulation of agreement, as long as ensureing that the audio, video data transmitted by source equipment 100 is reached
Protocol data processing module can be parsed normally, and take into account corresponding speed.As for specific communication association
Discuss form, naturally it is also possible to use a kind of ripe communications protocol, such as RTSP, RTP, VNC, WiDi, Miracast ... etc..
(agreement needed for following touching signals and data is similarly no longer particularly pointed out).
Simultaneous communications protocol data processing module also returns touch-control the touch data progress communications protocol obtained by module
Pack, and pass back to source module 100 and handled.
The audio frequency and video Qos management modules:For managing the transmission quality problem in whole transmitting procedure, if for example touched
To the weak situation of WIFI signal, it is impossible to allow virtual USB disk file module to read to cause the broadcasting of target terminal equipment 300 less than data
Device occur it is abnormal, audio frequency and video Qos management modules can be inserted according to the audio, video data received before simulation and forecast data come
Realize.For example, inserting the data of the midway film frame of video to complete;Or lose received by WIFI module be not inconsistent it is qualified
Picture frame data of formula etc..
The agreement unpacks module and audio/video flow synthetic video file format coding module:Pass through the conjunction of the two modules
Make, the packet that above-mentioned communications protocol is obtained is unpacked again according to audio frequency and video form, and asked according to target end equipment
Form carries out being re-encoded as allowing the file format content streams of destination end player plays.This content stream is stored in internal memory
Caching in, for virtual USB disk file system module to this caching carry out Linear content reading.
The implementation method of the virtual USB disk file system module, registered in (SuSE) Linux OS file system and
Corresponding virtual MTD external equipments (Memory Technology Device, be abbreviated as MTD), that is, be registered as RamFS (internal memories
File system) form.File format can use FAT32, the general file system such as eXFAT at present, it is therefore an objective to allow target
The file system that terminal device 300 can be recognized.So as to which the multimedia player system built in target terminal can normally be read
The data flow of file is taken, is played out.By taking FAT32 as an example, externally provided using vfat file system management model.External
The interface of file system meets Mass Storage USB external interface specifications.
In addition, touch-control coding/decoding module and touch-control passback module are optional modules, effect is to receive target terminal institute
The touching signals of transformation, and source equipment 100 is transmitted to by protocol data processing module realizes operation.
During as the USB Virtual File System mapping devices itself mapped, screen and touch-control viewing hardware can be carried,
Man-machine interaction can be realized by remote control 500 without screen.So mapping device 200 directly can be thought into source
Equipment 100, directly passes through the acquisition on-screen data similar with source device systems and audio by the screen display of mapping device 200
The similar flow of data, the source equipment that mapping device 200 is changed into mapping.Without by WIFI/USB etc. it is wireless or
Wired data transmission procedure.
Described source equipment 100 in the present embodiment contains polytype, such as mobile phone, tablet personal computer, PC etc.
Form.The operating system that these source equipment 100 are used, is following several at present:Android (Android), Windows
(Microsoft's Window), IOS (Apple Inc.'s operating system) and several classes of Linux, also have the operating system of higher level in the future.Jointly
Point is that the source software that these equipment possess in the ability for installing software, the present embodiment is exactly to operate in these source equipment behaviour
Make a whole set of software systems on system.
The implementation of this patent needs to carry out the exploitation and adaptation work of source software for the operating system of each type,
It is set to possess each key modules shown in Fig. 7, these modules include:
Display data on the screen acquisition module:The display data on the screen of source equipment is obtained, the method implemented with
Exemplified by Android, the FrameBuffer of screen is got using the figure bank interface of Android bottoms, can also be used
The feasible modes such as android high-level interface EGL interfaces obtain on-screen data.
Audio acquisition module:The interface of source device operating system is called to obtain the voice data of source equipment.With
Exemplified by Android, by the Router (route) of audio, the sound that Android application programs are played is routed to audio and obtained
Modulus block, so as to obtain the data of audio.
Video compressing module and audio compression module and audio/video coding module:For why putting together, be because
For generally we are using the audio frequency and video number that above-mentioned module is collected is handled using the audio/video coding of standard, these codings are assisted
View contains compression and the coding to audio frequency and video.H.264 and MP4 it is typical to represent such as.By taking Android as an example, then use
H.264 audio/video coding is carried out.
The Qos management modules of audio frequency and video:The screen that origin end equipment can be obtained with the interface capability of call operation system shows
Show ability, such as resolution ratio, color depth key parameter obtain the coding/decoding capability of this source, than such as whether having what hardware was decoded
Ability etc..Simultaneously by monitoring the state of WIFI communication passage, the ability of dynamic adjustment coding, to reach the purpose of smoothness.
Belong to integrated dispatch adjusting module.Realization on Android, the WIFI Qos abilities that Android can be called to be provided are looked into
The relevant interface of inquiry and Android capacity of equipment.
Protocol data processing module in the present embodiment:The related data of audio/video encoding/decoding module output, in communication
Protocol data processing module, is carried out package, and data can be carried out data transmission by WIFI or USB.This part
The implementation of module can use RTSP or RTP etc. protocol mode.If source terminal possesses known to a certain kind in itself
Shadowing agreement (such as Miracast, WIDI etc.), we can also directly invoke the source device and have by way of calling
Shadowing agreement, send the packet within away.
Touch-control decoder module and touch-control processing module:Be responsible for from this patent protocol data processing module obtain parse it is tactile
Data are controlled, touch data is decoded, then by the relevant interface of touch-control processing module call operation system, reality is performed
Touch-control it is actual, the purpose of Application Program Interface will be mapped in voltage input end equipment 100 by reaching.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized:With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means to combine specific features, structure, material or the spy that the embodiment or example are described
Point is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not
Necessarily refer to identical embodiment or example.Moreover, specific features, structure, material or the feature of description can be any
One or more embodiments or example in combine in an appropriate manner.
In general, the various embodiments of the disclosure can be with hardware or special circuit, software, logic or its any combination
Implement.Some aspects can be implemented with hardware, and some other aspect can be with firmware or software implementation, and the firmware or software can
With by controller, microprocessor or other computing devices.Although the various aspects of the disclosure be shown and described as block diagram,
Flow chart is represented using some other drawing, but it is understood that frame described herein, equipment, system, techniques or methods can
With in a non limiting manner with hardware, software, firmware, special circuit or logic, common hardware or controller or other calculating
Equipment or some of combination are implemented.
In addition, although operation is described with particular order, but this is understood not to require this generic operation with shown suitable
Sequence is performed or performed with generic sequence, or requires that all shown operations are performed to realize expected result.In some feelings
Under shape, multitask or parallel processing can be favourable.Similarly, although the details of some specific implementations is superincumbent to beg for
By comprising but these are not necessarily to be construed as any limitation of scope of this disclosure, but the description of feature is only pin in
To specific embodiment.Some features described in some embodiments of separation can also in combination be held in single embodiment
OK.Mutually oppose, the various features described in single embodiment can also be implemented separately or to appoint in various embodiments
The mode of what suitable sub-portfolio is implemented.
Claims (10)
1. USB interface-based audio video transmission and the system of multi-screen mapping, it is characterised in that including:
Possess USB interface and/or video reads the target end equipment of playing function, to the carrier as screen map,
Possess the mapping device of USB Virtual File Systems, be configured as by the MassStorage agreements based on USB standard
USB interface is connected with the target end equipment, and the target end equipment obtains dynamic by accessing the USB Virtual File Systems
The data of generation.
2. USB interface-based audio video transmission and the system of multi-screen mapping, it is characterised in that including:
Source equipment, to the device as screen map,
Possess the target end equipment that USB interface and/or video read playing function, to the screen as the source equipment or
The carrier of audio frequency and video mapping,
Possess the mapping device of USB Virtual File Systems, be configured as being connected with the target end equipment by USB interface,
The target end equipment obtains the data of dynamic generation by accessing the USB Virtual File Systems.
3. system according to claim 1, it is characterised in that the mapping device is specifically included:One virtual USB disk file system
Module of uniting and an audio/video flow synthetic video file format coding module,
The virtual USB disk file system module, for producing a Virtual File System on USB interface,
The audio/video flow synthetic video file format coding module, for providing institute for above-mentioned virtual USB disk file system module
The file content of request, when the virtual USB disk file system module accesses the content of file by USB, and by audio frequency and video
The related pattern data flow of Virtual File System is synthesized, exports and gives virtual USB disk file system module.
4. system according to claim 3, it is characterised in that also include:Video compressing module, audio compression module, sound
Video encoding module, default file interface processing module,
The video compressing module, to be stored in audio/video coding module after video original data is compressed,
The audio compression module, to be stored in audio/video coding module after audio raw data is compressed,
The audio/video coding module, audio/video coding is synthesized into setting formatted data stream,
The audio/video coding module is connected with audio/video flow synthetic video file format coding module,
The default file interface processing module, to obtain file directory or data locally or remotely, and completes corresponding
Adaptation or operation.
5. system according to claim 2, it is characterised in that also include:One touch signal transferring device, to by described in
The touching signals of target end equipment are sent to the mapping device by touching signals forwarding interface, and are returned by mapping device
By calling touch-controlling interface to complete touch control operation on to source equipment.
6. system according to claim 1, it is characterised in that also include:One remote control equipment, for the mapping device
It is connected by bluetooth or WI-F I, touch/the straighforward operation of button.
7. system according to claim 2, it is characterised in that generate player media row in the target end equipment
Table, to be corresponded to after each source facility registration on the player media list, produce supporting virtual text
Part is pressed from both sides and corresponding document data.
8. system according to claim 2, it is characterised in that the source equipment is wirelessly transferred and mapped by WI-F I
Device is connected, and the mapping device is connected by USB communication modes with the target end equipment.
9. USB interface-based audio video transmission and multi-screen mapping from mapping method, it is characterised in that comprise the following steps:
S1 will be provided with USB interface and/or video and read the target end equipment of playing function as the carrier of screen map,
The mapping device that S2 will be provided with USB Virtual File Systems is configured to by the Mass Storage agreements based on USB standard
USB interface be connected with the target end equipment, the target end equipment obtains dynamic by accessing the USB Virtual File Systems
The data of state generation.
10. USB interface-based audio video transmission and the method for multi-screen mapping, it is characterised in that comprise the following steps:
S1 is when mapping device is inserted into the USB interface of target end equipment by USB interface, and mapping device works on power, and waits
Other source device connections are treated, while the USB interface in the mapping device simulates a USB based on Mass Storage agreements
Virtual File System,
S2 starts an application program in the source equipment, and searches the connectable device of periphery adaptation, is reflected by authenticating connection
Injection device,
S3 is by after the source equipment and the mapping device successful connection, the USB Virtual File Systems in the mapping device
Corresponding Virtual File System catalogue and listed files structure will be generated according to source equipment,
File in the above-mentioned listed files structure of audio and video playing procedure selections of the S4 in target end equipment is played out.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710266045.7A CN107168666B (en) | 2017-04-21 | 2017-04-21 | System and method for audio and video transmission and multi-screen mapping based on USB interface |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710266045.7A CN107168666B (en) | 2017-04-21 | 2017-04-21 | System and method for audio and video transmission and multi-screen mapping based on USB interface |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107168666A true CN107168666A (en) | 2017-09-15 |
CN107168666B CN107168666B (en) | 2021-01-26 |
Family
ID=59813385
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710266045.7A Active CN107168666B (en) | 2017-04-21 | 2017-04-21 | System and method for audio and video transmission and multi-screen mapping based on USB interface |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107168666B (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107506494A (en) * | 2017-09-27 | 2017-12-22 | 广东欧珀移动通信有限公司 | Document handling method, mobile terminal and computer-readable recording medium |
CN108234673A (en) * | 2018-02-14 | 2018-06-29 | 上海赫千电子科技有限公司 | Vehicle-carrying distribution mapped system and mapping method |
CN108710481A (en) * | 2018-05-17 | 2018-10-26 | 深圳市柏尚科技有限公司 | A kind of wired same screen systems of USB |
CN109819201A (en) * | 2019-03-08 | 2019-05-28 | 厦门亿联网络技术股份有限公司 | A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment |
CN110798644A (en) * | 2019-10-30 | 2020-02-14 | 深圳市亿联智能有限公司 | Wireless screen-casting conference system based on HDMI signal conversion |
CN111787394A (en) * | 2020-06-19 | 2020-10-16 | 深圳市点嘀互联网络有限公司 | Method for mapping audio data of mobile phone to car machine through embedded equipment |
CN112565609A (en) * | 2020-12-08 | 2021-03-26 | 浙江合众新能源汽车有限公司 | Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot |
CN112672313A (en) * | 2020-12-18 | 2021-04-16 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for transmitting data |
CN115174537A (en) * | 2022-06-30 | 2022-10-11 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-machine interaction |
EP4202911A1 (en) | 2021-12-24 | 2023-06-28 | Magic Control Technology Corporation | Interface extension device for screen sharing |
CN117119615A (en) * | 2023-10-25 | 2023-11-24 | 吉林藤兴科技有限公司 | Screen throwing method for intelligent mobile terminal to control large screen in vehicle |
CN117453171A (en) * | 2023-12-23 | 2024-01-26 | 深圳市一恒科电子科技有限公司 | Virtual mapping method and device for android system display and virtual mapping system |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201066887Y (en) * | 2007-08-01 | 2008-05-28 | 青岛海信电器股份有限公司 | Wireless communication system and audio/video receiving device with wireless communication function |
US8310656B2 (en) * | 2006-09-28 | 2012-11-13 | Sony Computer Entertainment America Llc | Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen |
CN102917261A (en) * | 2012-10-08 | 2013-02-06 | 清华大学 | Storage equipment with streaming media supporting function |
EP2648110A1 (en) * | 2012-04-05 | 2013-10-09 | BlackBerry Limited | Method for sharing an internal storage of a portable electronic device on a host electronic device and an electronic device configured for same |
CN103648021A (en) * | 2013-12-24 | 2014-03-19 | 深圳国微技术有限公司 | Method for playing network video files from USB storage device |
CN204425453U (en) * | 2014-08-22 | 2015-06-24 | 荣成华泰汽车有限公司 | Automobile entertainment audio-visual devices and mobile phone interconnected systems |
CN105045548A (en) * | 2015-06-16 | 2015-11-11 | 广州视睿电子科技有限公司 | Wireless screen transmission method, expansion equipment and wireless screen transmission system |
CN106331733A (en) * | 2016-09-28 | 2017-01-11 | 广东科学技术职业学院 | Desktop cloud terminal's audio and video data real-time processing method and system |
-
2017
- 2017-04-21 CN CN201710266045.7A patent/CN107168666B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8310656B2 (en) * | 2006-09-28 | 2012-11-13 | Sony Computer Entertainment America Llc | Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen |
CN201066887Y (en) * | 2007-08-01 | 2008-05-28 | 青岛海信电器股份有限公司 | Wireless communication system and audio/video receiving device with wireless communication function |
EP2648110A1 (en) * | 2012-04-05 | 2013-10-09 | BlackBerry Limited | Method for sharing an internal storage of a portable electronic device on a host electronic device and an electronic device configured for same |
CN102917261A (en) * | 2012-10-08 | 2013-02-06 | 清华大学 | Storage equipment with streaming media supporting function |
CN103648021A (en) * | 2013-12-24 | 2014-03-19 | 深圳国微技术有限公司 | Method for playing network video files from USB storage device |
CN204425453U (en) * | 2014-08-22 | 2015-06-24 | 荣成华泰汽车有限公司 | Automobile entertainment audio-visual devices and mobile phone interconnected systems |
CN105045548A (en) * | 2015-06-16 | 2015-11-11 | 广州视睿电子科技有限公司 | Wireless screen transmission method, expansion equipment and wireless screen transmission system |
CN106331733A (en) * | 2016-09-28 | 2017-01-11 | 广东科学技术职业学院 | Desktop cloud terminal's audio and video data real-time processing method and system |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107506494B (en) * | 2017-09-27 | 2019-04-12 | Oppo广东移动通信有限公司 | Document handling method, mobile terminal and computer readable storage medium |
CN107506494A (en) * | 2017-09-27 | 2017-12-22 | 广东欧珀移动通信有限公司 | Document handling method, mobile terminal and computer-readable recording medium |
CN108234673A (en) * | 2018-02-14 | 2018-06-29 | 上海赫千电子科技有限公司 | Vehicle-carrying distribution mapped system and mapping method |
CN108710481A (en) * | 2018-05-17 | 2018-10-26 | 深圳市柏尚科技有限公司 | A kind of wired same screen systems of USB |
CN109819201A (en) * | 2019-03-08 | 2019-05-28 | 厦门亿联网络技术股份有限公司 | A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment |
CN110798644A (en) * | 2019-10-30 | 2020-02-14 | 深圳市亿联智能有限公司 | Wireless screen-casting conference system based on HDMI signal conversion |
CN111787394A (en) * | 2020-06-19 | 2020-10-16 | 深圳市点嘀互联网络有限公司 | Method for mapping audio data of mobile phone to car machine through embedded equipment |
CN112565609B (en) * | 2020-12-08 | 2022-08-12 | 浙江合众新能源汽车有限公司 | Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot |
CN112565609A (en) * | 2020-12-08 | 2021-03-26 | 浙江合众新能源汽车有限公司 | Image processing method and system based on vehicle-mounted machine system and vehicle-mounted robot |
CN112672313A (en) * | 2020-12-18 | 2021-04-16 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for transmitting data |
CN112672313B (en) * | 2020-12-18 | 2023-04-25 | 阿波罗智联(北京)科技有限公司 | Method, apparatus, device and storage medium for transmitting data |
EP4202911A1 (en) | 2021-12-24 | 2023-06-28 | Magic Control Technology Corporation | Interface extension device for screen sharing |
TWI811916B (en) * | 2021-12-24 | 2023-08-11 | 茂傑國際股份有限公司 | Interface extension device for screen sharing |
CN115174537A (en) * | 2022-06-30 | 2022-10-11 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-machine interaction |
CN115174537B (en) * | 2022-06-30 | 2023-07-21 | 重庆长安汽车股份有限公司 | Double-screen interaction method and system for vehicle-computer interaction |
CN117119615A (en) * | 2023-10-25 | 2023-11-24 | 吉林藤兴科技有限公司 | Screen throwing method for intelligent mobile terminal to control large screen in vehicle |
CN117453171A (en) * | 2023-12-23 | 2024-01-26 | 深圳市一恒科电子科技有限公司 | Virtual mapping method and device for android system display and virtual mapping system |
Also Published As
Publication number | Publication date |
---|---|
CN107168666B (en) | 2021-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107168666A (en) | The system and method for USB interface-based audio video transmission and multi-screen mapping | |
WO2021109487A1 (en) | Control method for audio data stream output and display device | |
US9288534B2 (en) | Systems and methods for operating media devices | |
CN101755299A (en) | Mobile wireless display for accessing data from a host and method for controlling | |
TW200917758A (en) | Operation of media interface to provide bidirectional communications | |
JP2023503679A (en) | MULTI-WINDOW DISPLAY METHOD, ELECTRONIC DEVICE AND SYSTEM | |
CN106385621A (en) | Intelligent device control method and device | |
CN103841182A (en) | Wireless hotspot device sharing video image | |
CN112383803B (en) | Information processing method and related device | |
CN103516882B (en) | A kind of based on multi-screen interaction scene picture playing method and system | |
CN203164829U (en) | Wireless high definition transmission screen intelligent all-in-one machine | |
CN104202461A (en) | Connected smart phone function synchronizing automotive sound system | |
CN105025349B (en) | The throwing screen of encryption | |
CN103281580A (en) | Television set remote control method for separating user interface and system thereof | |
CN109819201A (en) | A kind of meeting secondary flow data transmission method, display methods, conference system and peripheral equipment | |
CN103516994A (en) | Multi-screen adapter camera configuration method, multi-screen adapter and multi-screen interaction system | |
WO2018133571A1 (en) | Distributed pc system based on mobile intelligent terminal | |
CN103813122A (en) | Image device control system, image device serial connection equipment and image device control method | |
CN102147566A (en) | Multimedia projector with embedded operation system | |
CN104094603A (en) | Systems and methods for integrated metadata insertion in a video encoding system | |
CN113225838A (en) | Microphone control method, audio receiving equipment and audio collecting equipment | |
CN103391475B (en) | Display device and intelligent apparatus | |
CN104991769A (en) | Hostless computer | |
CN104094219B (en) | Method and apparatus for audio distribution | |
CN101964902A (en) | Network video stream playing method and connecting equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |