CN110232050A - The method and electronic equipment that a kind of language based on programming compresses file - Google Patents

The method and electronic equipment that a kind of language based on programming compresses file Download PDF

Info

Publication number
CN110232050A
CN110232050A CN201910335096.XA CN201910335096A CN110232050A CN 110232050 A CN110232050 A CN 110232050A CN 201910335096 A CN201910335096 A CN 201910335096A CN 110232050 A CN110232050 A CN 110232050A
Authority
CN
China
Prior art keywords
file
compressed
format
programming
compression
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910335096.XA
Other languages
Chinese (zh)
Inventor
李天驰
孙悦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Dianmao Technology Co Ltd
Original Assignee
Shenzhen Dianmao Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Dianmao Technology Co Ltd filed Critical Shenzhen Dianmao Technology Co Ltd
Priority to CN201910335096.XA priority Critical patent/CN110232050A/en
Publication of CN110232050A publication Critical patent/CN110232050A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/174Redundancy elimination performed by the file system
    • G06F16/1744Redundancy elimination performed by the file system using compression, e.g. sparse files

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention discloses the method and electronic equipment that a kind of language based on programming compresses file, wherein method includes: acquisition file destination, and is Optimized Row Columnar format by the format conversion of file destination;The file destination that format is Optimized Row Columnar format is compressed by compression algorithm, obtains compressed file.The method provided through the invention, first file destination can be converted to the file (specified format are as follows: Optimized Row Columnar) of specified format, then the file after conversion is compressed by compression algorithm, to obtain compressed file.In this way, can effectively be reduced to the volume of target minimum, disk is enabled to store more files.Moreover, compared with prior art, the present invention changing has the characteristics that Fast Compression and protection file destination, in other words, method provided by the invention is hardly damaged file destination, while can also be to file destination Fast Compression.

Description

The method and electronic equipment that a kind of language based on programming compresses file
Technical field
The present invention relates to programming language field, more particularly to a kind of language based on programming method that file is compressed and Electronic equipment.
Background technique
Existing file generally comprises the information such as picture, text or video, therefore, occupied space (the i.e. file of file Size) it is larger, often a file just occupies the big quantity space of system disk.
Common method is first to carry out compression processing to file, and file can reduce certain deposit after compression processing Space is stored up, but comparatively, the occupied memory space of file is still excessive, and asking for memory space inadequate often occurs in disk Topic.
That is, the prior art can not effectively compress file, compression of the prior art to file in other words Efficiency is lower, is unable to satisfy the demand of most users.
Therefore, the existing technology needs to be improved and developed.
Summary of the invention
In view of above-mentioned deficiencies of the prior art, the purpose of the present invention is to provide a kind of language based on programming to carry out to file The method and electronic equipment of compression, it is intended to solve the problems, such as that the prior art can not Efficient Compression file.
Technical scheme is as follows:
A method of language compresses file based on programming comprising step:
A, file destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
B, the file destination that format is Optimized Row Columnar format is compressed by compression algorithm, is obtained To compressed file.
The method that the language based on programming compresses file, wherein the file destination is text file.
The method that the language based on programming compresses file, wherein the compression algorithm is Snappy compression Algorithm.
The method that the language based on programming compresses file, wherein include: after the step B
C, the compressed file is stored in specified directory.
The method that the language based on programming compresses file, wherein the step B is specifically included:
B1, by the compression algorithm reading format be Optimized Row Columnar format file destination;
B2, it is compressed according to preset compression ratio and compression time, obtains compressed file.
The method that the language based on programming compresses file, wherein the compression ratio is 1:3.
The method that the language based on programming compresses file, wherein include: before the step C
The instruction that user modifies compressed file title is received, modifies, is obtained containing target to the title of compressed file The compressed file of title.
The present invention also provides a kind of electronic equipment comprising:
Processor is adapted for carrying out each instruction, and
Equipment is stored, is suitable for storing a plurality of instruction, described instruction is suitable for being loaded and being executed by processor:
File destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
The file destination that format is Optimized Row Columnar format is compressed by compression algorithm, is obtained Compressed file.
The present invention also provides a kind of computer program products, wherein computer program product is non-volatile including being stored in Computer program on computer readable storage medium, computer program include program instruction, when program instruction is held by processor When row, the processor is made to execute the method that the language based on programming compresses file.
The present invention also provides a kind of non-volatile computer readable storage medium storing program for executing, wherein the non-volatile computer can It reads storage medium and is stored with computer executable instructions, when which is executed by one or more processors, One or more of processors may make to execute the method that the language based on programming compresses file.
The utility model has the advantages that the method provided through the invention, can first (refer to the file that file destination is converted into specified format Fix formula are as follows: Optimized Row Columnar), compression processing is then carried out to the file after conversion by compression algorithm, To obtain compressed file.In this way, can effectively be reduced to the volume of target minimum, disk is stored more More files.Moreover, it compared with prior art, the present invention also having the characteristics that Fast Compression and protection file destination, changes Sentence is talked about, and method provided by the invention is hardly damaged file destination, while can also be to file destination Fast Compression.
Detailed description of the invention
Fig. 1 is the flow chart for the method preferred embodiment compressed the present invention is based on programming language to file.
Fig. 2 is the structural block diagram of electronic equipment preferred embodiment of the present invention.
Specific embodiment
The present invention provides the method and electronic equipment that a kind of language based on programming compresses file, of the invention to make Purpose, technical solution and effect are clearer, clear, and the present invention is described in more detail below.It should be appreciated that this place is retouched The specific embodiment stated is only used to explain the present invention, is not intended to limit the present invention.
Referring to Fig. 1, a kind of method that language compresses file based on programming comprising step:
S1, file destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
S2, the file destination that format is Optimized Row Columnar format is compressed by compression algorithm, Obtain compressed file.
The method provided through the invention can effectively compress file destination, to obtain the pressure of small volume Contracting file achievees the purpose that disk storage space is greatly lowered, and disk is enabled to store more file destinations.Also, After file destination compression, additionally it is possible to facilitate user to be managed compressed file, facilitates the quick locating file of user in other words, And user is facilitated quickly to carry out the operation such as editing to compressed file.
In the step S1, the file destination is primarily referred to as text file.It is led since the present invention is applied to programming language Domain, and programming language (code file) is mainly stored in disk in the form of text file, in such manner, it is possible to convenient to further Programming language is modified, and facilitates and text file is replicated or is sheared into third party software.However existing text file Containing a large amount of codes (thousands of line codes), therefore, text file can occupy a large amount of disk space, and disk is deposited frequent occurrence The problem of storing up insufficient space, is also more troublesome in addition, user directly searches text file.
Although the operation that can be compressed by compressed files such as war to file destination, however, this kind of compressed software Efficiently file destination can not be compressed, in other words, accounting for for file destination can not be effectively reduced in existing compressed software With space, the compressed occupied spatial volume of file destination and original file destination the space occupied volume difference are little, For example, the size of existing file destination is 10G, and the size of the compressed file obtained after being compressed by compressed file is The occupied space of file destination can not be effectively reduced in 9.8G, therefore, existing compressed software.
Moreover, user's store code file in the form of text file is not easy to search although facilitating editor A line therein or lines of code.User is switched on text file, then finds object code line by line, this mode is inquired Speed is slower, and efficiency is also extremely inefficient.
Optimized Row Columnar format is converted by text file, can reduce memory space and accelerates to look into Ask speed.
Wherein, the file format of ORC (Optimized Row Columnar) format is one of hadoop ecosphere Column storage format has very high compression ratio and reading efficiency earliest from Apache Hive.Optimized Row Columnar is other than having very high compression ratio and reading efficiency, an also built-in lightweight index, to significantly mention Rise query performance.
Specifically, user can convert Optimized Row for text file by the java program edited in advance The file of Columnar format.Its key step is as follows: the interim table of one orcfile format of creation;In target hive data Library creates the formal table of an orcfile format;In source hive database, change data format (is converted text file to Optimized Row Columnar format).In this way, the format conversion operation of file destination can be completed.
In the step S2, the file destination after conversion format is added in compression algorithm, compression algorithm is then passed through To Optimized Row Columnar compressing file, to obtain compressed file.
Wherein, the compression algorithm refers to a kind of compression function, can be safe and rapidly right by compression algorithm Optimized Row Columnar compressing file, obtains corresponding compressed file.
Preferably, the compression algorithm is Snappy compression algorithm.
Snappy compression algorithm (being once called as: Zippy compression algorithm) is that Google is write based on the thinking of LZ77 with C Plus Plus Rapid data compression with decompression program library, and 2011 increase income.Its target is not maximum compression rate or compresses journey with other The compatibility of sequence, but very high speed and reasonable compression ratio.It is operated at the Intel Core i7 under 64 bit patterns using one The single core of device is managed, compression speed 250MB/s decompresses speed 500MB/s.The low 20-100% of compression ratio ratio gzip.
Snappy compression algorithm is widely used in the project of Google, for example, BigTable, MapReduce and Google The compressed data of internal RPC system.It can also be used in open source projects, for example, Cassandra, Hadoop, LevelDB, In the projects such as MongoDB, RocksDB and Lucene.In addition, the compressed file compressed by Snappy compression algorithm, when When carrying out decompression operations to compressed file, it will detect and be kept away with the presence or absence of mistake to further increase efficiency in compression stream automatically Exempting from the decompressing files that decompression obtains, there are format or form errors.
Preferably, the step S2 is specifically included:
S21, by the compression algorithm reading format be Optimized Row Columnar format file destination;
S22, it is compressed according to preset compression ratio and compression time, obtains compressed file.
In the step S21, the address information of file destination is inputted in compression algorithm, then compression algorithm will obtain automatically The suffix name of each file in address information is taken, and judges whether suffix name is ORC format, if it is, by corresponding file It is passed into compression algorithm, if it is not, then abandoning corresponding file, and continues to judge next file.
Certainly, user can also directly add the target of Optimized Row Columnar format by manually mode File then chooses Optimized Row specifically, first opening destination folder (file of storage file destination) The file destination of Columnar format, and be added in compression algorithm, to complete the operation of addition file destination manually.
Preferably, user can also add file destination in batches, i.e. user can once add multiple file destinations to compression In algorithm.
It should be noted that if user adds multiple file destinations, compression algorithm will automatically by multiple file destinations into Row merges, and obtains merging file, and subsequent step will obtain compressing text accordingly automatically to file execution squeeze operation is merged Part.
In the step S22, user can input compression ratio and compression time, never control the compression of compression algorithm Efficiency.Specifically, the compression ratio refer to file destination compression after and compression before ratio, for example, file destination compress Preceding occupied space is 2G, and the compressed occupied space of file destination is 1G, then compression ratio is just 1:2.When the compression Between refer to execution time of compression algorithm, comparatively, compression time is longer, and the effect of compression is also better, i.e., compressed file is not It will appear excessive wrong file or error code.
Preferably, the compression ratio is 1:3.
It is found by many experiments, when setting 1:3 for compression ratio, accounting for for file destination can not only be effectively reduced With space, at this point, the occupied space of compressed file is only the one third of original target file, additionally it is possible to increase substantially compression Efficiency.
In this way, the method provided through the invention can compress file destination, to be compressed accordingly File.
Preferably, include: after the step S2
S3, the compressed file is stored in specified directory.
After obtaining compressed file, compressed file can be directly stored in specified directory by user, and certainly, user can also First to be edited to compressed file, for example, the partial code inside modification compressed file, after the completion of modification, then will compression File is stored in specified directory.
Preferably, include: before the step S3
The instruction that user modifies compressed file title is received, modifies, is obtained containing target to the title of compressed file The compressed file of title.
User can modify the title of compressed file, so that the title of compressed file meets the requirements, in this way, user also can be more Add easy-to-look-up compressed file.
Preferably, include: after the step S3
Setting time interval, and according to the storage period of time interval prompting user's compressed file.
In order to further increase the utilization efficiency of disk, a time interval can be preset, when then calculating current Between time difference with the time of compressed file, and the time difference being calculated and the time interval are compared, obtain phase The comparing result answered continues after current time update if comparing result is the time difference to be less than or equal to time interval Calculate the time difference;If comparing result is the time difference to be greater than the time interval, corresponding prompting, side are sent to user Just user in time clears up compressed file.
Specifically, the current time refers to the current time of electronic equipment, the time of the compressed file refers to use The time of family Last modification compressed file.By calculating the time difference of current time and compressed file, can judge to press The storage time of contracting file, to judge whether the storage time of compressed file is too long, if the storage time mistake of compressed file It is long, it can send and remind to user, inform the user that the operation cleared up in time compressed file.
Preferably, the time interval is 30 days.In this way, if the storage time of compressed file is more than 30 days, it can The notice of cleaning compressed file is sent to user in time.
Preferably, compressed file is cleared up automatically according to cleaning cycle.
After sending cleaning notice to user, user may directly ignore cleaning notice, and compressed file is caused to continue to store In disk.If the compressed file that do not clear up is more than cleaning cycle, then cleaning notice is sent to user again, and cleared up logical Know the message comprising being cleared up automatically compressed file.Specifically, if user ignores this cleaning notice, at one Cleaning notice is sent to user again after announcement period;If user confirms this cleaning notice, then it represents that cleaning is turned off manually Notification window, and corresponding compressed file is deleted at once.
Preferably, the announcement period is 1 week.That is, if user ignored this cleaning notice, at one week Afterwards, system will send cleaning notice to user again.
Preferably, compressed file is ranked up automatically according to the size of compressed file occupied space, most by occupied space Big compressed file makes number one, and the smallest compressed file of occupied space is rolled into last place.In this way, can be according to accounting for Compressed file is ranked up automatically with the sequence of space from big to small, so that convenient be managed compressed file.
Preferably, if the occupied space of compressed file is greater than first threshold, corresponding compressed file is stored in first In file;If the occupied space of compressed file is less than or is equal to first threshold, and is greater than second threshold, then by corresponding compression File is stored in the second file;If the occupied space of compressed file is less than or is equal to second threshold, and is greater than 0, then will be right The compressed file answered is stored in third file.
That is, can be according to the size divided rank of compressed file, so that the compressed file in same rank be deposited It is stored in same file folder, thus more convenient management.
Preferably, the size of the first threshold is twice of the second threshold.In this way, management effect can be improved Rate.
Preferably, the first threshold is 2G, and the second threshold is 1G.That is, if the occupancy of compressed file Space is greater than 2G, then corresponding compressed file is stored in the first file;If the occupied space of compressed file is greater than 1G And be less than or equal to 2G, then corresponding compressed file is stored in the second file;If the occupied space of compressed file Greater than 0 and it is less than or equal to 1G, then corresponding compressed file is stored in third file.
Preferably, the pressure in the first file, the second file and third file is cleared up according to preset cleaning cycle Contracting file.In this way, can periodic cleaning compressed file.
Preferably, the compressed file in the first file is cleared up according to 1 cleaning cycle, is cleared up according to 0.8 cleaning cycle Compressed file in second file, according to the compressed file in 0.5 cleaning cycle cleaning third file.In this way, Faster to clear up big file, to substantially reduce the memory space of disk.It should be noted that above-mentioned cleaning is true in user After recognizing, cleaning operation is just carried out, is not to clear up automatically, the hidden danger accidentally deleted can be prevented in this way.
Preferably, the cleaning cycle is 1 month, 3 months or is 1 year.In this way, long-term occupancy system can be deleted The compressed file of disk.
Preferably, after the step S3 further include:
The instruction that user decompresses compressed file is received, corresponding decompressing files is obtained.
It when user needs to obtain the code content in compressed file, needs to decompress compressed file, to obtain phase The decompressing files answered, in this way, user can search object code from decompressing files, to execute duplication to object code, compile The operation collected or sheared.
Preferably, after the step S3 further include:
The instruction that user edits object code is received, to modify object code.
User can more easily edit object code after decompressing compressed file, to obtain effective Object code.
Referring to Fig. 2, the present invention also provides a kind of electronic equipment 10 comprising:
Processor 110 is adapted for carrying out each instruction, and
Equipment 120 is stored, is suitable for storing a plurality of instruction, described instruction is suitable for being loaded and being executed by processor:
File destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
The file destination that format is Optimized Row Columnar format is compressed by compression algorithm, is obtained Compressed file.
The processor 110 can for general processor, digital signal processor (DSP), specific integrated circuit (ASIC), Field programmable gate array (FPGA), single-chip microcontroller, ARM (Acorn RISC Machine) or other programmable logic device are divided Any combination of vertical door or transistor logic, discrete hardware component or these components.In addition, processor can also be any Conventional processors, microprocessor or state machine.Processor also may be implemented as calculating the combination of equipment, for example, DSP and Wei Chu Manage combination, multi-microprocessor, one or more microprocessors combination DSP core, any other this configuration of device.
It stores equipment 120 and is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software Program, non-volatile computer executable program and module, as the language based on programming in the embodiment of the present invention to file into The corresponding program instruction of method of row compression.Processor by operation be stored in storage equipment in non-volatile software program, Instruction and unit, at the various function application and data of the method compressed thereby executing language based on programming to file The method that reason, i.e. language based on programming in realization above method embodiment compress file.
It about the particular technique details of above-mentioned electronic equipment 10, is described in detail in above-mentioned steps, so not repeating them here.
The method that the language based on programming compresses file, wherein the file destination is text file.
The method that the language based on programming compresses file, wherein the compression algorithm is Snappy compression Algorithm.
The method that the language based on programming compresses file, wherein described to be to format by compression algorithm Include: after the step of file destination of Optimized Row Columnar format is compressed, obtains compressed file
The compressed file is stored in specified directory.
The method that the language based on programming compresses file, wherein described to be to format by compression algorithm The step of file destination of Optimized Row Columnar format is compressed, obtains compressed file specifically includes:
It is the file destination of Optimized Row Columnar format by the compression algorithm reading format;
It is compressed according to preset compression ratio and compression time, obtains compressed file.
The method that the language based on programming compresses file, wherein the compression ratio is 1:3.
The method that the language based on programming compresses file, wherein described to be stored in the compressed file Step includes: before in specified directory
The instruction that user modifies compressed file title is received, modifies, is obtained containing target to the title of compressed file The compressed file of title.
The present invention also provides a kind of computer program products, wherein computer program product is non-volatile including being stored in Computer program on computer readable storage medium, computer program include program instruction, when program instruction is held by processor When row, the processor is made to execute the method that the language based on programming compresses file.
The present invention also provides a kind of non-volatile computer readable storage medium storing program for executing, wherein the non-volatile computer can It reads storage medium and is stored with computer executable instructions, when which is executed by one or more processors, One or more of processors may make to execute the method that the language based on programming compresses file.
It should be understood that the application of the present invention is not limited to the above for those of ordinary skills can With improvement or transformation based on the above description, all these modifications and variations all should belong to the guarantor of appended claims of the present invention Protect range.

Claims (10)

1. a kind of method that language compresses file based on programming, which is characterized in that comprising steps of
A, file destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
B, the file destination that format is Optimized Row Columnar format is compressed by compression algorithm, is pressed Contracting file.
2. the method that language compresses file based on programming according to claim 1, which is characterized in that the target text Part is text file.
3. the method that language compresses file based on programming according to claim 1, which is characterized in that the compression is calculated Method is Snappy compression algorithm.
4. the method that language compresses file based on programming according to claim 1, which is characterized in that the step B Include: later
C, the compressed file is stored in specified directory.
5. the method that language compresses file based on programming according to claim 1, which is characterized in that the step B It specifically includes:
B1, by the compression algorithm reading format be Optimized Row Columnar format file destination;
B2, it is compressed according to preset compression ratio and compression time, obtains compressed file.
6. the method that language compresses file based on programming according to claim 5, which is characterized in that the compression ratio Rate is 1:3.
7. the method that language compresses file based on programming according to claim 4, which is characterized in that the step C Include: before
The instruction that user modifies compressed file title is received, modifies, is obtained containing target designation to the title of compressed file Compressed file.
8. a kind of electronic equipment characterized by comprising
Processor is adapted for carrying out each instruction, and
Equipment is stored, is suitable for storing a plurality of instruction, described instruction is suitable for being loaded and being executed by processor:
File destination is obtained, and is Optimized Row Columnar format by the format conversion of file destination;
The file destination that format is Optimized Row Columnar format is compressed by compression algorithm, is compressed File.
9. a kind of computer program product, which is characterized in that computer program product can including being stored in non-volatile computer The computer program on storage medium is read, computer program includes program instruction, when program instruction is executed by processor, makes institute State the method that processor perform claim requires the described in any item language based on programming of 1-7 to compress file.
10. a kind of non-volatile computer readable storage medium storing program for executing, which is characterized in that the non-volatile computer readable storage medium Matter is stored with computer executable instructions, when which is executed by one or more processors, may make institute State the side that one or more processors perform claim requires the described in any item language based on programming of 1-7 to compress file Method.
CN201910335096.XA 2019-04-24 2019-04-24 The method and electronic equipment that a kind of language based on programming compresses file Pending CN110232050A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910335096.XA CN110232050A (en) 2019-04-24 2019-04-24 The method and electronic equipment that a kind of language based on programming compresses file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910335096.XA CN110232050A (en) 2019-04-24 2019-04-24 The method and electronic equipment that a kind of language based on programming compresses file

Publications (1)

Publication Number Publication Date
CN110232050A true CN110232050A (en) 2019-09-13

Family

ID=67860248

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910335096.XA Pending CN110232050A (en) 2019-04-24 2019-04-24 The method and electronic equipment that a kind of language based on programming compresses file

Country Status (1)

Country Link
CN (1) CN110232050A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954011A (en) * 2021-01-27 2021-06-11 上海淇玥信息技术有限公司 Image resource compression method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761540A (en) * 2012-05-30 2012-10-31 北京奇虎科技有限公司 Data compression method, device and system and server
CN105550296A (en) * 2015-12-10 2016-05-04 深圳市华讯方舟软件技术有限公司 Data importing method based on spark-SQL big data processing platform
CN105653698A (en) * 2015-12-30 2016-06-08 北京奇艺世纪科技有限公司 Data loading method and apparatus for database table Hive Table
CN105787119A (en) * 2016-03-25 2016-07-20 盛趣信息技术(上海)有限公司 Hybrid engine based big data processing method and system
CN109324792A (en) * 2018-10-09 2019-02-12 深圳点猫科技有限公司 A kind of the route construction automatic method and electronic equipment of language based on programming

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761540A (en) * 2012-05-30 2012-10-31 北京奇虎科技有限公司 Data compression method, device and system and server
CN105550296A (en) * 2015-12-10 2016-05-04 深圳市华讯方舟软件技术有限公司 Data importing method based on spark-SQL big data processing platform
CN105653698A (en) * 2015-12-30 2016-06-08 北京奇艺世纪科技有限公司 Data loading method and apparatus for database table Hive Table
CN105787119A (en) * 2016-03-25 2016-07-20 盛趣信息技术(上海)有限公司 Hybrid engine based big data processing method and system
CN109324792A (en) * 2018-10-09 2019-02-12 深圳点猫科技有限公司 A kind of the route construction automatic method and electronic equipment of language based on programming

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LYLE-LIANG: "《https://blog.csdn.net/feng12345zi/article/details/80509479?utm_medium=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-1.control&depth_1-utm_source=distribute.pc_relevant.none-task-blog-BlogCommendFromMachineLearnPai2-1.control》", 30 May 2018 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954011A (en) * 2021-01-27 2021-06-11 上海淇玥信息技术有限公司 Image resource compression method and device and electronic equipment
CN112954011B (en) * 2021-01-27 2023-11-10 上海淇玥信息技术有限公司 Image resource compression method and device and electronic equipment

Similar Documents

Publication Publication Date Title
CN106897322B (en) A kind of access method and device of database and file system
US20230325287A1 (en) Data backup method and apparatus, data recovery method and apparatus, and storage medium
US10474658B2 (en) User-defined loading of data onto a database
CN106611044B (en) SQL optimization method and equipment
WO2015139381A1 (en) Terminal software upgrade method and device
WO2005104456A1 (en) Fixed length data search device and search management method
CN107145538B (en) Table data query method, device and system
CN107451204B (en) Data query method, device and equipment
CN115617799A (en) Data storage method, device, equipment and storage medium
CN109324792B (en) Automatic route construction method based on programming language and electronic equipment
CN110232050A (en) The method and electronic equipment that a kind of language based on programming compresses file
WO2024036974A1 (en) Repeated operation extraction method, electronic device, and storage medium
WO2024078122A1 (en) Database table scanning method and apparatus, and device
CN116775599A (en) Data migration method, device, electronic equipment and storage medium
CN111125216A (en) Method and device for importing data into Phoenix
US8463759B2 (en) Method and system for compressing data
CN107463618B (en) Index creating method and device
CN108228592B (en) Data archiving method and data archiving device based on binary log
CN108874891B (en) Method for facilitating reading of family cloud disk files
CN109408462A (en) A kind of document storage management method and electronic equipment based on educational system
CN111026764A (en) Data storage method and device, electronic product and storage medium
WO2019119336A1 (en) Multi-thread compression and decompression methods in generic data gz format, and device
JP2010250434A (en) Apparatus and method for processing information, program, and storage medium
CN110674220A (en) Data heterogeneous method, device and equipment
US10037148B2 (en) Facilitating reverse reading of sequentially stored, variable-length data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190913

RJ01 Rejection of invention patent application after publication