WO2022174553A1 - 文件处理方法、装置、电子设备和存储介质 - Google Patents
文件处理方法、装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2022174553A1 WO2022174553A1 PCT/CN2021/108012 CN2021108012W WO2022174553A1 WO 2022174553 A1 WO2022174553 A1 WO 2022174553A1 CN 2021108012 W CN2021108012 W CN 2021108012W WO 2022174553 A1 WO2022174553 A1 WO 2022174553A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- container
- file
- target node
- scheduling group
- operation request
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000012423 maintenance Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 239000003795 chemical substances by application Substances 0.000 description 8
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/188—Virtual file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Definitions
- the present disclosure relates to the field of computer technologies, and in particular, to the field of cloud computing.
- container cluster management systems such as Kubernetes
- Kubernetes for the creation and deployment of containers have also been widely used.
- users In actual deployment and operation, users often need to view the internal files of the system and copy the internal files of the system to the outside for backup and analysis.
- Commonly viewed and backed up file types include run logs, run data, and more.
- the present disclosure provides a file processing method, apparatus, electronic device and storage medium.
- a file processing method comprising:
- a file processing apparatus comprising:
- the container determination module is used to determine the container corresponding to the container scheduling group information in the target node based on the container scheduling group information corresponding to the file operation request received by the target node;
- the path determination module is used to determine the file path of the container by using the node directory of the target node;
- the file operation module is used to operate the file under the file path according to the file operation request.
- an electronic device comprising:
- the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method in any of the embodiments of the present disclosure.
- a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method in any of the embodiments of the present disclosure.
- a computer program product comprising a computer program that, when executed by a processor, implements the method in any of the embodiments of the present disclosure.
- the embodiment of the present disclosure provides a file processing method when a target node receives a file operation request, locates a specific container based on the container scheduling group information, and uses the node directory to determine the file path of the container, so that the files in the container cluster management system can be processed. operation, eliminating the use of proprietary commands, reducing operation and maintenance requirements and having better compatibility.
- FIG. 1 is a schematic diagram of a file processing method provided by an embodiment of the present disclosure
- FIG. 2 is a schematic diagram of a file processing method provided by another embodiment of the present disclosure.
- FIG. 3 is a schematic diagram of a file processing apparatus provided by an embodiment of the present disclosure.
- FIG. 4 is a schematic diagram of a file processing apparatus provided by another embodiment of the present disclosure.
- FIG. 5 is a block diagram of an electronic device used to implement the file method of an embodiment of the present disclosure.
- FIG. 1 shows a schematic diagram of a file operation method provided by an embodiment of the present disclosure. As shown in Figure 1, the method may include:
- Step S110 based on the container scheduling group information corresponding to the file operation request received by the target node, determine the container corresponding to the container scheduling group information in the target node;
- Step S120 using the node directory of the target node to determine the file path of the container
- Step S130 according to the file operation request, operate the file under the file path.
- the target node may be a node (Node) in the container cluster management system.
- Container cluster management systems such as Kubernetes, are container orchestration tools that support automated deployment and management of containerized applications. Compared with virtual machines, containers can be deployed quickly, and containers are decoupled from underlying facilities and machine file systems, so they can be migrated between different clouds and different versions of operating systems.
- a node is a hardware unit or a single machine in the container cluster management system, and is the host of the container.
- Container scheduling group, or Pod is the smallest unit for container cluster management system to create, schedule, and manage containers. It is a collection of multiple containers. It provides a higher level of abstraction than containers, making deployment and management more flexible. For example, Kubernetes does not schedule containers directly, but encapsulates containers into Pods. Containers in the same Pod will share the same namespace and local network, and containers can easily communicate within the same pod.
- the above steps S11 to S13 in the embodiment of the present disclosure may be performed by the target node, and specifically, may be performed by a file management agent module (Agent) in the target node.
- a file management agent module can be set in each node of Kubernetes, and the requesting device that initiates the file operation request can send the file operation request to the distribution service module, and the distribution service module determines the target node and sends the file operation request. to the target node.
- the container scheduling group information corresponding to the file operation request may be included in the file operation request, or obtained by querying the metadata information set of Kubernetes according to the relevant information in the file operation request.
- the file for the requested operation of the file operation request may include operation logs, operation data, and the like.
- the container scheduling group information corresponding to the request can be mapped to a specific container (Container) in the node.
- the container here may refer to a container that runs according to the standard of the container runtime in the node after being created, where the container runtime is a software tool for executing the container and managing the container image on the node.
- Docker may be used when the container is running, and correspondingly, a specific container in a node may also be referred to as a Docker Container or a Docker container.
- the file path to be operated can be found by using the node directory of the target node.
- the node directory may refer to a directory for reflecting the file system of the entire container, or a collection of paths.
- operations can be performed on the files in the file path, such as viewing or copying, according to the file operation request.
- a file processing method is provided when a target node receives a file operation request, locates a specific container based on the container scheduling group information, and uses the node directory to determine the file path of the container. file operation, eliminating the use of proprietary file operation commands such as the tar command, reducing operation and maintenance requirements and having better compatibility.
- the file management agent module as the module for the Pod file in the dedicated management node, the compatibility can be further improved, and the permission scheme of the video memory in different user systems and the file management scheme of the bastion machine can be connected.
- the above method may further include:
- the container scheduling group created by the container cluster management system corresponds to the target node, create a container on the target node, and obtain the file view of the container and the data volume mount directory of the container scheduling group;
- the above steps may be performed by the target node, and specifically, may be performed by a container runtime such as Docker in the target node.
- a container runtime such as Docker in the target node.
- containers run on nodes.
- Docker is used as the underlying container runtime
- Kubernetes can create a Pod container on the node corresponding to the Pod every time it creates a Pod, and the container will eventually run according to Docker's standards.
- the underlying container runtime determines a file view for the container.
- a container can be provided with a complete file view in a joint mount manner.
- the joint mounted file view will be mounted on the node directory of the target node, so that the node directory of the target node can reflect the file system of the container.
- the container when the container is running, it will mount some data volumes (Volumes) required by the container scheduling group. For example, use the Mount command to mount the data volumes required by the Pod to obtain the data volume mount directory.
- the data volume mount directory also exists in the node directory.
- the node directory can reflect the file systems of all containers in the node, and can The complete information required to operate the file is determined through the node directory, which is beneficial to realize the convenient operation of the file in the node.
- step S120 using the node directory of the target node to determine the file path of the container, including:
- the corresponding file view and data volume mounting directory can be found in the node directory according to the determined container. For example, in the node directory, find the file path of the joint mount and the file path mounted by the Mount command through the Docker Container. Therefore, the corresponding file view and data volume mount directory are used to accurately locate the file, and operate the file on the node to meet the user's needs.
- step S110 based on the container scheduling group information corresponding to the file operation request received by the target node, determine the container corresponding to the container scheduling group information in the target node, including:
- a container corresponding to the container scheduling group information is determined.
- the file management agent module is also used to realize the container logical name conversion between the container scheduling group and the container management tool, for example, the logical name conversion from the container of the Kubernetes Pod to the Docker container, so as to obtain the name information of the Docker container, This enables the node to map the Pod information to the specific Docker container in the node.
- the file under the file path is operated, including:
- the local file service is, for example, Fileserver.
- Fileserver you can directly manipulate the directory files mounted by the node federation according to the file path.
- the operation type specified by the file operation request can include read, copy, delete, etc.
- the file is directly operated through a local file service such as Fileserver, which has better transmission performance.
- the above method may further include:
- the distribution service module queries the container scheduling group information corresponding to the metadata information in the file operation request in the metadata information collection of the container cluster management system, and locates the target according to the container scheduling group information node, which sends the file operation request to the target node.
- FIG. 2 shows a schematic diagram of operating on a pod file when the underlying container runtime of Kubernetes is docker according to the above embodiment.
- Kubernetes 200 includes a plurality of nodes 220.
- the requesting device sends a file operation request for a certain pod file to the distribution service module (Dispenser) 210 .
- the distribution service module 210 receives the file operation request, locates the node 220 where the pod is located, and establishes a connection with the file management agent module 221 in the node 220 .
- the file management agent module 221 After the file management agent module 221 establishes a connection with the distribution service module 210 and receives the file operation request for the pod file, it corresponds the pod information corresponding to the file operation request to the specific Docker container 222 of the node. Using the node directory 223, the jointly mounted file path and the Mount file path are found through the Docker container 222. Based on these file paths, file requests are processed through Fileserver. Fileserver directly manipulates the directory files mounted by the node federation.
- the target node where the relevant container scheduling group is located can be located. Therefore, the file path can be directly determined in the target node where the container scheduling group is located. , which is more efficient than using proprietary commands to enter each node.
- the embodiments of the present disclosure provide a file processing method when a target node receives a file operation request, which can be applied to a cloud-native microservice application platform, such as a Stack platform. Locate a specific container based on the container scheduling group information, and use the node directory to determine the file path of the container, so that the files in the container cluster management system can be operated, eliminating the use of proprietary commands, reducing operation and maintenance requirements and having more good compatibility.
- a cloud-native microservice application platform such as a Stack platform.
- FIG. 3 shows a schematic diagram of a file processing apparatus provided by an embodiment of the present disclosure.
- the device includes:
- the container determination module 310 is configured to determine the container corresponding to the container scheduling group information in the target node based on the container scheduling group information corresponding to the file operation request received by the target node;
- the path determination module 320 is used for determining the file path of the container by using the node directory of the target node;
- the file operation module 330 is configured to operate the file under the file path according to the file operation request.
- the file processing apparatus may further include:
- the container creation module 410 is configured to create a container on the target node when the container scheduling group created by the container cluster management system corresponds to the target node, and obtain the file view of the container and the data volume mount directory of the container scheduling group;
- the directory mounting module 420 is configured to mount the file view of the container and the data volume mounting directory of the container scheduling group in the node directory of the target node.
- the path determination module 320 is used to:
- the container determination module 310 includes:
- the conversion unit 311 is configured to perform logical name conversion from the container scheduling group to the container management tool based on the container scheduling group information corresponding to the file operation request received by the target node, to obtain container name information;
- the determining unit 312 is configured to determine the container corresponding to the container scheduling group information based on the container name information.
- the file manipulation module 330 is used to:
- the file processing apparatus may further include:
- the distribution service module 430 is configured to, in the case of receiving the file operation request, query the container scheduling group information corresponding to the metadata information in the file operation request in the metadata information set of the container cluster management system, and according to the container scheduling group The information is located to the target node, and the file operation request is sent to the target node.
- the file processing apparatus provided by the embodiment of the present disclosure can implement the file processing method provided by the embodiment of the present disclosure, and has corresponding beneficial effects.
- the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
- FIG. 5 shows a schematic block diagram of an example electronic device 500 that may be used to implement embodiments of the present disclosure.
- Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers.
- Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices.
- the components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
- the electronic device 500 includes a computing unit 501 that can be executed according to a computer program stored in a read only memory (ROM) 502 or a computer program loaded from a storage unit 508 into a random access memory (RAM) 503 Various appropriate actions and handling. In the RAM 503, various programs and data required for the operation of the electronic device 500 can also be stored.
- the computing unit 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504.
- An input output (I/O) interface 505 is also connected to bus 504 .
- Various components in the electronic device 500 are connected to the I/O interface 505, including: an input unit 506, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of displays, speakers, etc.; a storage unit 508, such as a magnetic disk, an optical disk etc.; and a communication unit 509, such as a network card, modem, wireless communication transceiver, and the like.
- the communication unit 509 allows the electronic device 500 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
- Computing unit 501 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 501 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc.
- the computing unit 501 executes the various methods and processes described above, such as a file processing method.
- the file processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 508 .
- part or all of the computer program may be loaded and/or installed on electronic device 500 via ROM 502 and/or communication unit 509 .
- the computer program When the computer program is loaded into RAM 503 and executed by computing unit 501, one or more steps of the file processing method described above may be performed.
- the computing unit 501 may be configured to perform the file processing method by any other suitable means (eg, by means of firmware).
- Various implementations of the systems and techniques described herein above may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips system (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof.
- FPGAs field programmable gate arrays
- ASICs application specific integrated circuits
- ASSPs application specific standard products
- SOC systems on chips system
- CPLD load programmable logic device
- computer hardware firmware, software, and/or combinations thereof.
- These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that
- the processor which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.
- Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented.
- the program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.
- a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing.
- machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- CD-ROM compact disk read only memory
- magnetic storage or any suitable combination of the foregoing.
- the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer.
- a display device eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
- a keyboard and pointing device eg, a mouse or trackball
- Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input to receive input from the user.
- the systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system.
- the components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
- a computer system can include clients and servers.
- Clients and servers are generally remote from each other and usually interact through a communication network.
- the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (15)
- 一种文件处理方法,包括:基于目标节点接收到的文件操作请求所对应的容器调度组信息,确定所述目标节点中与所述容器调度组信息对应的容器;利用所述目标节点的节点目录,确定所述容器的文件路径;根据所述文件操作请求,对所述文件路径下的文件进行操作。
- 根据权利要求1所述的方法,还包括:在容器集群管理***创建的容器调度组对应于所述目标节点的情况下,在所述目标节点上创建容器,并获取所述容器的文件视图以及所述容器调度组的数据卷挂载目录;将所述容器的文件视图以及所述容器调度组的数据卷挂载目录挂载在所述目标节点的节点目录中。
- 根据权利要求2所述的方法,其中,所述利用所述目标节点的节点目录,确定所述容器的文件路径,包括:根据所述容器,在所述目标节点的节点目录中查找对应的文件视图和数据卷挂载目录。
- 根据权利要求1-3中任一项所述的方法,其中,所述基于目标节点接收到的文件操作请求所对应的容器调度组信息,确定所述目标节点中与所述容器调度组信息对应的容器,包括:基于目标节点接收到的文件操作请求所对应的容器调度组信息,进行容器调度组到容器管理工具之间的容器逻辑名称转换,得到容器名称信息;基于所述容器名称信息,确定与所述容器调度组信息对应的容器。
- 根据权利要求1-3中任一项所述的方法,其中,所述根据所述文件操作请求,对所述文件路径下的文件进行操作,包括:利用本地文件服务,对所述文件路径下的文件执行与所述文件操作请求指定的操作类型对应的操作。
- 根据权利要求1-3中任一项所述的方法,还包括:分发服务模块在接收到文件操作请求的情况下,在容器集群管理***的元数据信息集合中查询与所述文件操作请求中的元数据信息对应的容器调度组信息,并根据所述容器调度组信息定位到所述目标节点,将所述文件操作请求发送至所述目标节点。
- 一种文件处理装置,包括:容器确定模块,用于基于目标节点接收到的文件操作请求所对应的容器调度组信息,确定所述目标节点中与所述容器调度组信息对应的容器;路径确定模块,用于利用所述目标节点的节点目录,确定所述容器的文件路径;文件操作模块,用于根据所述文件操作请求,对所述文件路径下的文件进行操作。
- 根据权利要求7所述的装置,还包括:容器创建模块,用于在容器集群管理***创建的容器调度组对应于所述目标节点的情况下,在所述目标节点上创建容器,并获取所述容器的文件视图以及所述容器调度组的数据卷挂载目录;目录挂载模块,用于将所述容器的文件视图以及所述容器调度组的数据卷挂载目录挂载在所述目标节点的节点目录中。
- 根据权利要求8所述的装置,其中,所述路径确定模块用于:根据所述容器,在所述目标节点的节点目录中查找对应的文件视图和数据卷挂载目录。
- 根据权利要求7-9中任一项所述的装置,其中,所述容器确定模块,包括:转换单元,用于基于目标节点接收到的文件操作请求所对应的容器调度组信息进行容器调度组到容器管理工具的逻辑名称转换,得到容器名称信息;确定单元,用于基于所述容器名称信息,确定与所述容器调度组信息对应的容器。
- 根据权利要求7-9中任一项所述的装置,其中,所述文件操作模块用于:利用本地文件服务,对所述文件路径下的文件执行与所述文件操作请求指定的操作类型对应的操作。
- 根据权利要求7-9中任一项所述的装置,还包括:分发服务模块,用于在接收到文件操作请求的情况下,在容器集群管理***的元数据信息集合中查询与所述文件操作请求中的元数据信息对应的容器调度组信息,并根据所述容器调度组信息定位到所述目标节点,将所述文件操作请求发送至所述目标节点。
- 一种电子设备,其特征在于,包括:至少一个处理器;以及与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-6中任一项所述的方法。
- 一种存储有计算机指令的非瞬时计算机可读存储介质,其特征在于,所述计算机指令用于使计算机执行权利要求1-6中任一项所述的方法。
- 一种计算机程序产品,包括计算机程序,该计算机程序在被处理器执行时实现根据权利要求1-6中任一项所述的方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020227004988A KR20220026603A (ko) | 2021-02-20 | 2021-07-23 | 파일 처리 방법, 장치, 전자 기기 및 저장 매체 |
US17/641,370 US20240054107A1 (en) | 2021-02-20 | 2021-07-23 | File processing method, electronic device, and storage medium |
JP2022513682A JP2023518136A (ja) | 2021-02-20 | 2021-07-23 | ファイル処理方法、装置、電子デバイス、記憶媒体、及びプログラム |
EP21844172.3A EP4075269A4 (en) | 2021-07-23 | File processing method and apparatus, electronic device, and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110194453.2A CN112905537B (zh) | 2021-02-20 | 2021-02-20 | 文件处理方法、装置、电子设备和存储介质 |
CN202110194453.2 | 2021-02-20 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022174553A1 true WO2022174553A1 (zh) | 2022-08-25 |
Family
ID=76124181
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/108012 WO2022174553A1 (zh) | 2021-02-20 | 2021-07-23 | 文件处理方法、装置、电子设备和存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112905537B (zh) |
WO (1) | WO2022174553A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112905537B (zh) * | 2021-02-20 | 2022-09-02 | 北京百度网讯科技有限公司 | 文件处理方法、装置、电子设备和存储介质 |
CN114064594B (zh) * | 2021-11-22 | 2023-09-22 | 马上消费金融股份有限公司 | 数据处理方法和装置 |
CN115333836B (zh) * | 2022-08-12 | 2023-05-30 | 北京百度网讯科技有限公司 | 验证文件的处理方法、装置、电子设备及可读存储介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109491859A (zh) * | 2018-10-16 | 2019-03-19 | 华南理工大学 | 针对Kubernetes集群中容器日志的收集方法 |
CN110704376A (zh) * | 2019-09-04 | 2020-01-17 | 广东浪潮大数据研究有限公司 | 日志文件保存方法及装置 |
US20200057618A1 (en) * | 2018-08-14 | 2020-02-20 | Hyperblox Inc. | Software Acceleration Platform for Supporting Decomposed, On-Demand Network Services |
CN111046011A (zh) * | 2019-11-27 | 2020-04-21 | 中科曙光国际信息产业有限公司 | 日志收集方法、***、节点、电子设备及可读存储介质 |
CN111352691A (zh) * | 2018-12-21 | 2020-06-30 | 北京神州泰岳软件股份有限公司 | 一种日志采集方法和*** |
CN112905537A (zh) * | 2021-02-20 | 2021-06-04 | 北京百度网讯科技有限公司 | 文件处理方法、装置、电子设备和存储介质 |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7739318B2 (en) * | 2005-06-20 | 2010-06-15 | Netapp, Inc. | System and method for maintaining mappings from data containers to their parent directories |
US7707193B2 (en) * | 2005-09-22 | 2010-04-27 | Netapp, Inc. | System and method for verifying and restoring the consistency of inode to pathname mappings in a filesystem |
CN106383852B (zh) * | 2016-08-30 | 2019-11-05 | 中国民生银行股份有限公司 | 基于Docker容器的日志获取方法和装置 |
CN106789303B (zh) * | 2016-12-29 | 2020-04-03 | 北京奇艺世纪科技有限公司 | 一种容器日志采集方法及装置 |
CN107169016B (zh) * | 2017-03-31 | 2020-01-10 | 北京奇艺世纪科技有限公司 | 一种应用程序日志采集方法及装置 |
US10678935B2 (en) * | 2017-04-11 | 2020-06-09 | Nicira, Inc. | Identifying container file events for providing container security |
CN108845917A (zh) * | 2018-04-09 | 2018-11-20 | 东峡大通(北京)管理咨询有限公司 | 容器内文件日志挂载模块、***和方法 |
CN108681434A (zh) * | 2018-05-24 | 2018-10-19 | 中科边缘智慧信息科技(苏州)有限公司 | 一种容器持久存储挂载方法 |
US20200125533A1 (en) * | 2018-10-22 | 2020-04-23 | Outcold Solutions LLC | System and method for locating a file created by a process running in a linux container |
CN111367615B (zh) * | 2018-12-26 | 2023-08-18 | 卓望数码技术(深圳)有限公司 | 方便容器实例调度的方法、装置、设备及存储介质 |
CN109818934B (zh) * | 2018-12-29 | 2021-10-22 | 达闼机器人有限公司 | 一种自动化日志处理的方法、装置及计算设备 |
CN110012087B (zh) * | 2019-03-28 | 2022-02-01 | 中国工商银行股份有限公司 | 数据处理***及数据处理方法 |
CN109977093A (zh) * | 2019-04-04 | 2019-07-05 | 中科创达(重庆)汽车科技有限公司 | 基于lxc的多虚拟***查看容器日志的方法及装置 |
CN110659246B (zh) * | 2019-09-26 | 2022-05-03 | 北京百度网讯科技有限公司 | 基于容器的文件挂载方法、装置及电子设备 |
CN110688201B (zh) * | 2019-09-29 | 2022-06-28 | 重庆小雨点小额贷款有限公司 | 一种日志管理方法及相关设备 |
CN110888852A (zh) * | 2019-11-11 | 2020-03-17 | 北京宝兰德软件股份有限公司 | 一种挂载宿主机目录到容器环境中的方法及装置 |
CN110955578A (zh) * | 2019-11-26 | 2020-04-03 | 深圳市信联征信有限公司 | 基于宿主机的日志收集方法、装置、计算机设备及存储介质 |
CN111274091B (zh) * | 2020-01-17 | 2024-01-09 | 北京达佳互联信息技术有限公司 | 日志的处理方法、装置、计算机设备和存储介质 |
CN111309546A (zh) * | 2020-01-19 | 2020-06-19 | 苏州浪潮智能科技有限公司 | 一种集群容器内文本日志的采集方法、***及存储介质 |
CN111488320A (zh) * | 2020-04-17 | 2020-08-04 | 上海思询信息科技有限公司 | 一种清理Kubernetes中业务应用程序日志的方法 |
CN111782339B (zh) * | 2020-06-28 | 2024-04-12 | 京东科技控股股份有限公司 | 一种容器创建方法、装置、电子设备及存储介质 |
CN111913665B (zh) * | 2020-07-30 | 2023-11-24 | 北京星辰天合科技股份有限公司 | 存储卷的挂载方法及装置、电子设备 |
CN111966305B (zh) * | 2020-10-22 | 2021-02-09 | 腾讯科技(深圳)有限公司 | 持久卷分配方法、装置、计算机设备和存储介质 |
CN112379828B (zh) * | 2020-10-27 | 2024-03-19 | 华云数据控股集团有限公司 | 基于动态文件***的容器创建方法及装置 |
-
2021
- 2021-02-20 CN CN202110194453.2A patent/CN112905537B/zh active Active
- 2021-07-23 WO PCT/CN2021/108012 patent/WO2022174553A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200057618A1 (en) * | 2018-08-14 | 2020-02-20 | Hyperblox Inc. | Software Acceleration Platform for Supporting Decomposed, On-Demand Network Services |
CN109491859A (zh) * | 2018-10-16 | 2019-03-19 | 华南理工大学 | 针对Kubernetes集群中容器日志的收集方法 |
CN111352691A (zh) * | 2018-12-21 | 2020-06-30 | 北京神州泰岳软件股份有限公司 | 一种日志采集方法和*** |
CN110704376A (zh) * | 2019-09-04 | 2020-01-17 | 广东浪潮大数据研究有限公司 | 日志文件保存方法及装置 |
CN111046011A (zh) * | 2019-11-27 | 2020-04-21 | 中科曙光国际信息产业有限公司 | 日志收集方法、***、节点、电子设备及可读存储介质 |
CN112905537A (zh) * | 2021-02-20 | 2021-06-04 | 北京百度网讯科技有限公司 | 文件处理方法、装置、电子设备和存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN112905537A (zh) | 2021-06-04 |
CN112905537B (zh) | 2022-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022174553A1 (zh) | 文件处理方法、装置、电子设备和存储介质 | |
US8170981B1 (en) | Computer method and system for combining OLTP database and OLAP database environments | |
CN110100228A (zh) | 利用云对象存储的文件***层次结构的高效增量备份和恢复 | |
US20120047107A1 (en) | System and method for implementing on demand cloud database | |
WO2023093245A1 (zh) | 基于分布式文件***的元数据查询方法、设备和存储介质 | |
JP2006012155A (ja) | ユーザ定義型の指定されたメンバを遅延フェッチするシステムおよび方法 | |
US11334526B2 (en) | Handling previews of remotely stored content objects | |
US11216421B2 (en) | Extensible streams for operations on external systems | |
US11983184B2 (en) | Multi-tenant, metadata-driven recommendation system | |
US20070174360A1 (en) | Storage system embedding database | |
WO2015094195A1 (en) | Transaction query engine | |
JP2024521730A (ja) | Sqlクエリを加速するための決定的分散キャッシュのための技術 | |
US20170228383A1 (en) | Active archive bridge | |
US11461274B2 (en) | Processing streams on external data sources | |
EP4075269A1 (en) | File processing method and apparatus, electronic device, and storage medium | |
US20240054107A1 (en) | File processing method, electronic device, and storage medium | |
US20220075830A1 (en) | Resumable ordered recursive traversal of an unordered directory tree | |
US11178216B2 (en) | Generating client applications from service model descriptions | |
US9471587B2 (en) | Remote enumeration of a directory | |
US11030241B2 (en) | Query usage based organization for very large databases | |
US20240028593A1 (en) | In-memory graph query engine with persisted storage | |
US11914610B1 (en) | Multi-way data store conversion | |
US20240202075A1 (en) | Dynamic slicing of filesystem data with application awareness | |
US11379147B2 (en) | Method, device, and computer program product for managing storage system | |
CN107423375B (zh) | 应用程序搜索方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2021844172 Country of ref document: EP Effective date: 20220126 |
|
ENP | Entry into the national phase |
Ref document number: 20227004988 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2022513682 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 17641370 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |