CN109344140A - Data access method, device, electronic device and computer storage medium - Google Patents

Abstract

The present application relates to the technical field of data processing, and discloses a data access method, an apparatus, an electronic device and a computer-readable storage medium, wherein the data access method includes: based on a first preset correspondence between an access path and a working mode, determining The working mode corresponding to the currently obtained access path; then, if the working mode is not the preset working mode, the preset file system plug-in is used to access the data information in the file system of the corresponding version according to the working mode. The method of the embodiment of the present application can access any version of the file system based on the same client through the preset file system plug-in, that is, in the case of being transparent to the upper-layer application, the same client can be used to access files of various versions. Access to the system is compatible.

Description

Data access method, device, electronic device and computer storage medium

technical field

The present application relates to the technical field of data processing, and in particular, to a data access method, apparatus, electronic device, and computer storage medium.

Background technique

Hadoop implements a distributed file system, HDFS (Hadoop Distributed File System). HDFS has the characteristics of high fault tolerance and can be designed to be deployed on inexpensive general-purpose hardware. At the same time, HDFS can provide high transfer rates to access applications. data, suitable for applications with very large data sets.

With the continuous development and update of technology, a new HDFS2.0 system has been released on the basis of HDFS1.0 system. The storage access method of HDFS2.0 system is very different from that of HDFS1.0 system. HDFS1.0 system The RPC (Remote Procedure Call Protocol) that comes with Hadoop is used for communication, while the HDFS2.0 system uses the PB (Protocol Buffer) protocol for communication.

At present, for different versions of HDFS systems (such as HDFS 1.0 and HDFS 2.0), you can use the corresponding clients to access different Versions of HDFS, for example, use client 1.0 to access data in HDFS 1.0, and use client 2.0 to access data in HDFS 2.0. However, if you want to use the client 2.0 to access the data in HDFS1.0, you must copy the data from HDFS1.0 to HDFS2.0. This process is not only complicated, but also consumes a long time, resulting in low efficiency. Low.

SUMMARY OF THE INVENTION

In order to overcome the above-mentioned technical problems or at least partially solve the above-mentioned technical problems, the following technical solutions are specially proposed:

In a first aspect, a data access method is provided, including:

Based on the first preset correspondence between the access path and the working mode, determining the working mode corresponding to the currently obtained access path;

If the working mode is not the preset working mode, the data information in the file system of the corresponding version is accessed according to the working mode through the preset file system plug-in.

Specifically, before accessing the data information in the file system of the corresponding version according to the working mode through the preset file system plug-in, the method further includes:

A second preset correspondence between the working mode and the version information of the file system is configured.

Further, through the preset file system plug-in, the data information in the file system of the corresponding version is accessed according to the working mode, including:

determining the version information of the file system corresponding to the working mode according to the second preset correspondence;

Through the preset file system plug-in, the data information in the corresponding file system is accessed according to the determined version information.

Further, before acquiring the data information in the corresponding file system according to the determined version information through the preset file system plug-in, the method further includes:

A third preset correspondence between the working mode and the class loader is configured.

Further, through the preset file system plug-in, according to the determined version information, the data information in the corresponding file system is obtained, including:

determining the class loader corresponding to the working mode according to the third preset correspondence;

Through the preset file system plug-in, load the Java archive file package of the file system corresponding to the version information according to the determined class loader;

Access data information in the file system according to the Java archive file package.

Further, the class loader loads the Java archive file package of the file system corresponding to the version information by means of reflection.

Further, it also includes:

If the working mode is the preset working mode, the Java archive file package of the file system of the corresponding version information is directly loaded according to the second preset corresponding relationship, so as to access the data information in the file system.

Further, the file system is a distributed file system HDFS.

In a second aspect, a data access device is provided, including:

a determining module, configured to determine the working mode corresponding to the currently obtained access path based on the first preset correspondence between the access path and the working mode;

The first processing module is configured to access the data information in the file system of the corresponding version according to the working mode through the preset file system plug-in when the working mode is not the preset working mode.

Specifically, it also includes a first configuration module;

The first configuration module is configured to configure the second preset correspondence between the working mode and the version information of the file system.

Further, the first processing module includes a version determination submodule and a data access submodule;

a version determination submodule, configured to determine the version information of the file system corresponding to the working mode according to the second preset correspondence;

The data access sub-module is used to access the data information in the corresponding file system according to the determined version information through the preset file system plug-in.

Further, it also includes a second configuration module;

The second configuration module is used to configure the third preset correspondence between the working mode and the class loader.

Further, the data access submodule includes a class loader determination subunit, a loading subunit and a data access subunit;

The class loader determines a subunit for determining the class loader corresponding to the working mode according to the third preset correspondence;

The loading subunit is used to load the Java archive file package of the file system corresponding to the version information according to the determined class loader through the preset file system plug-in;

The data access subunit is used to access data information in the file system according to the Java archive file package.

Further, the loading subunit is specifically used for the class loader to load the Java archive file package of the file system corresponding to the version information by means of reflection.

Further, it also includes a second processing module;

The second obtaining module is configured to directly load the Java archive file package of the file system of the corresponding version information according to the second preset correspondence when the working mode is the preset working mode, so as to obtain the data information in the file system.

Further, the file system is a distributed file system HDFS.

In a third aspect, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the above data access method when the program is executed.

In a fourth aspect, a computer-readable storage medium is provided, where a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the above-mentioned data access method is implemented.

In the data access method provided by the implementation of the present application, based on the first preset correspondence between the access path and the working mode, the working mode corresponding to the currently obtained access path is determined, which is used for the subsequent acquisition of the corresponding version of the file system according to the working mode. The data information provides premise guarantee; when the working mode is not the preset working mode, the data information in the corresponding version of the file system can be processed according to the working mode through the preset file system plug-in, so that the preset file system can be processed based on the same client. The system plug-in can access any version of the file system, that is, in the case of being transparent to the upper-layer application, it realizes the access compatibility of the file system of various versions through the same client, which not only effectively avoids the access through the corresponding version of the client. The tedious operation of the corresponding file system, and in the process of realizing compatible access, there is no need to copy the data in the file system of other versions to the file system of the current version, which reduces the operation complexity and improves the data access efficiency.

Additional aspects and advantages of the present application will be set forth in part in the following description, which will become apparent from the following description, or may be learned by practice of the present application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

1 is a schematic flowchart of a data access method according to an embodiment of the present application;

2 is a schematic process diagram of a data access method according to an embodiment of the present application;

3 is a schematic diagram of a basic structure of a data access device according to an embodiment of the present application;

FIG. 4 is a detailed structural schematic diagram of a data access device according to an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

The following describes in detail the embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, but not to be construed as a limitation on the present application.

It will be understood by those skilled in the art that the singular forms "a", "an", "the" and "the" as used herein can include the plural forms as well, unless expressly stated otherwise. It should be further understood that the word "comprising" used in the specification of this application refers to the presence of stated features, integers, steps, operations, elements and/or components, but does not preclude the presence or addition of one or more other features, Integers, steps, operations, elements, components and/or groups thereof. It will be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Furthermore, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Currently, for different versions of file systems (such as file system 1.0 and H file system.0), you can deploy different versions of clients (such as client 1.0 and client 2.0) on the same machine to use Corresponding clients access different versions of the file system, for example, use client 1.0 to access data in file system 1.0, and use client 2.0 to access data in file system 2.0, that is, when accessing different versions of the file system, you need to specify the corresponding For the upper-layer application, the operation process is very cumbersome, and it is impossible to realize the data sharing of different versions of the file system in the case of being transparent to the upper-layer application. In addition, if you want to use the client 2.0 to access the data in the file system 1.0, you must copy the data from the file system 1.0 to the file system 2.0. This process is not only complicated, but also consumes a long time, resulting in low efficiency. Low.

The data access method, device, electronic device, and computer-readable storage medium provided by the present application are intended to solve the above technical problems in the prior art.

The technical solutions of the present application and how the technical solutions of the present application solve the above-mentioned technical problems will be described in detail below with specific examples. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

Example 1

The embodiment of the present application provides a data access method, as shown in FIG. 1 , including:

Step S110 , based on the first preset correspondence between the access path and the working mode, determine the working mode corresponding to the currently obtained access path.

Specifically, when the client accesses the data information in the file system of the background server, it usually determines the corresponding file system according to the pre-stored working mode, so as to access the data information in the determined file system. When the client accesses data, it usually enters the access path in the client, so that the client can access the corresponding data information according to the access path. Therefore, the client needs to access the first preset correspondence between the access path and the working mode, such as access Path 1 corresponds to work mode 1, access path 2 corresponds to work mode 2, and access path 3 corresponds to work mode 3. Determine the work mode corresponding to the access path input by the user, that is, determine the work mode corresponding to the access path currently obtained by the client , and then determine the corresponding file system according to the working mode, and access the data information in the determined file system.

Step S120, if the working mode is not the preset working mode, access the data information in the file system of the corresponding version according to the working mode through the preset file system plug-in.

Specifically, during the client development process, a default working mode can be preset. For example, the default working mode corresponding to the client is working mode 2, and the working mode 2 is the default working mode of the client, that is, the client is the default working mode. The data information in the file system of the corresponding version is accessed based on the working mode 2. For example, the client accesses the data information in the file system 2.0 based on the working mode 2 by default. Among them, accessing the data information in the file system 2.0 includes not only reading or obtaining the data information in the file system 2.0, but also writing the data information in the file system 2.0, that is, writing to the file system 2.0. data information.

Further, in order to realize the compatibility of the client's access to the data information in the file systems of different versions, in the client development process, the client is also allowed to access the data information in the corresponding version of the file system in other working modes, such as the client. The client accesses the data information in the file system 1.0 in the working mode 1, and, for example, the client uses the working mode 3 to access the data information in the file system 3.0.

Further, the client can judge whether the working mode corresponding to the currently obtained access path is the preset working mode according to the interface of the file system (eg FileSystem), if the working mode corresponding to the currently obtained access path is not the preset working mode. If the working mode is set, it means that the client has compatible access to data information in file systems of other versions (eg, file system 1.0 and file system 3.0) except file system 2.0. At this time, the client accesses the data information in the file system of the corresponding version through the preset file system plug-in according to the working mode corresponding to the currently obtained access path, that is, the client cannot directly access the version corresponding to the preset working mode. other versions of the file system (such as file system 1.0, file system 3.0) other than the file system (such as file system 2.0), but indirectly access file system 1.0 or file system 3.0 through preset file system plug-ins, such as SpinnerFileSystem data information.

Compared with the prior art, the data access method provided by the embodiment of the present application determines the working mode corresponding to the currently obtained access path based on the first preset correspondence between the access path and the working mode, which is used for the follow-up according to the working mode. Obtaining the data information in the file system of the corresponding version provides a premise guarantee; when the working mode is not the preset working mode, the data information in the file system of the corresponding version is processed according to the working mode through the preset file system plug-in, so that the data information in the file system of the corresponding version can be processed based on the working mode The same client can access any version of the file system through the preset file system plug-in, that is, in the case of being transparent to the upper-layer application, it realizes the access compatibility of the file system of various versions through the same client, which not only effectively avoids the The cumbersome operation of the corresponding file system can only be accessed through the corresponding version of the client, and in the process of achieving compatible access, there is no need to copy the data in other versions of the file system to the current version of the file system, reducing the complexity of the operation , to improve data access efficiency.

Embodiment 2

The embodiment of the present application provides another possible implementation manner. On the basis of the first embodiment, the method shown in the second embodiment is also included, wherein,

The file system is the distributed file system HDFS.

Before step S120, step S111 (not marked in the figure) is further included: configuring a second preset correspondence between the working mode and the version information of the file system.

Step S120 includes step S1201 (not marked in the figure) and step S1202 (not marked in the figure), wherein,

Step S1201: Determine the version information of the file system corresponding to the working mode according to the second preset correspondence.

Step S1203: Access the data information in the corresponding file system through the preset file system plug-in and according to the determined version information.

Specifically, a second preset correspondence between the working mode and the version information of the distributed file system HDFS may be pre-configured, wherein there is a one-to-one correspondence between the working mode and the version information of HDFS, for example, the corresponding working mode 1 The version information of HDFS is version 1.0, that is, working mode 1 corresponds to HDFS1.0 one-to-one, and for example, the version information of HDFS corresponding to working mode 2 is version 2.0, that is, working mode 2 corresponds to HDFS2.0 one-to-one, and for example, work mode 2 corresponds to HDFS 2.0. The version information of HDFS corresponding to mode 3 is version 3.0, that is, the working mode 3 corresponds to HDFS 3.0 one-to-one. After pre-configuring the corresponding relationship between the working mode and the version information of HDFS, it is convenient to directly determine the corresponding version of HDFS according to the working mode, and access the data information in the corresponding version of HDFS according to the working mode.

Further, after the client determines the working mode corresponding to the currently obtained access path according to the first preset correspondence between the access path and the working mode, for example, it is determined that the working mode corresponding to the currently obtained access path is: Working mode 1, then the client can determine the version information of HDFS (eg version 1.0) corresponding to the current working mode (eg working mode 1) according to the second preset correspondence between the working mode and the version information of HDFS, That is, working mode 1 corresponds to HDFS 1.0. After determining the version information of HDFS corresponding to the current working mode, you can access the corresponding HDFS 1 according to the determined version information (such as version 1.0) through the preset file system plug-in. 0 data information.

For the embodiment of the present application, through the second preset correspondence between the working mode and the version information of HDFS, it is convenient to quickly and accurately determine the version information of HDFS corresponding to the current working mode, so that the client can pass the preset file system. The plug-in, according to the determined version information, realizes fast and efficient access to the data information in the corresponding version of HDFS, and realizes the compatible access to the data information in different versions of HDFS through the same client.

Embodiment 3

The embodiment of the present application provides another possible implementation manner. On the basis of the second embodiment, the method shown in the third embodiment is also included, wherein,

Before step S1203, step S1202 (not marked in the figure) is further included: configuring the third preset correspondence between the working mode and the class loader.

Step S1203 includes step S12031 (not marked in the figure), step S12032 (not marked in the figure) and step S12033 (not marked in the figure), wherein,

Step S12031: Determine the class loader corresponding to the working mode according to the third preset correspondence.

Step S12032: Load the Java archive file package of the file system corresponding to the version information according to the determined class loader by using the preset file system plug-in.

Step S12033: Access the data information in the file system according to the Java archive file package.

The class loader loads the Java archive file package of the file system corresponding to the version information by means of reflection.

Specifically, the preset file system plug-in realizes the access to the data information in the compatible version of HDFS (such as HDFS1.0, HDFS3.0) by means of reflection through the corresponding class loader. Assuming that the file system plug-in, according to the determined version information, before accessing the corresponding data information in HDFS, the third preset correspondence between the working mode and the class loader can be pre-configured, wherein the working mode and the class loader are related. There is a one-to-one correspondence, for example, working mode 1 corresponds to class loader 1, that is, working mode 1 corresponds to class loader 1 one-to-one, and for example, working mode 3 corresponds to class loader 3, that is, working mode 3 and class loader 3 One-to-one correspondence.

Further, after the client determines the working mode corresponding to the currently obtained access path according to the first preset correspondence between the access path and the working mode, for example, it is determined that the working mode corresponding to the currently obtained access path is: Working mode 1, then the client can determine the version information of HDFS (eg version 1.0) corresponding to the current working mode (eg working mode 1) according to the second preset correspondence between the working mode and the version information of HDFS, That is, the working mode 1 corresponds to HDFS 1.0, and then the client can determine the class loader ( For example, class loader 1), that is, working mode 1 corresponds to HDFS 1.0, and working mode 1 corresponds to class loader 1.

Further, the class loader implements the access to the data information in the compatible version of HDFS (for example, HDFS 1.0) by loading the Java archive file package of the compatible version of HDFS (for example, HDFS 1.0) in a reflection manner. Therefore, according to the corresponding relationship determined above (that is, the working mode 1 corresponds to HDFS1.0, and the working mode 1 corresponds to the class loader 1), the HDFS of the to-be-compatible version can be loaded through the class loader 1 by reflection (for example, HDFS1.0) Java archive file package, and then access data information in the corresponding version of HDFS (for example, HDFS1.0) according to the Java archive file package.

For the embodiments of the present application, by introducing the relevant Java archive file package and changing the configuration, the upper-layer application can use the unified client to read/write data information in different versions of HDFS without perception, and can be implemented during HDFS migration. data connectivity.

Embodiment 4

The embodiment of the present application provides another possible implementation manner, and on the basis of the first embodiment to the third embodiment, the method shown in the fourth embodiment is also included, wherein,

Also includes step S130 (not marked in the figure): if the working mode is a preset working mode, then according to the second preset corresponding relationship, directly load the Java archive file package of the file system of the corresponding version information to access the file system in the file system. Data information.

Specifically, during the client development process, a default working mode can be preset. For example, the default working mode corresponding to the client is working mode 2, and the working mode 2 is the default working mode of the client, that is, the client is the default working mode. Access data information in the corresponding version of HDFS based on work mode 2. For example, the client accesses data information in HDFS 2.0 based on work mode 2 by default.

Further, the client can judge whether the working mode corresponding to the currently obtained access path is the preset working mode according to the interface of the file system (eg FileSystem), if the working mode corresponding to the currently obtained access path is the preset working mode. Assume the working mode, for example, the working mode corresponding to the currently obtained access path is working mode 2 (preset working mode), then according to the above-mentioned second preset correspondence, it can be determined that the default access of the client is HDFS2.0 data information in . At this time, the client cannot directly load the Java archive file package of HDFS with the corresponding version information by means of any plug-in or class loader, and directly access the data information in the HDFS 2.0.

Further, FIG. 2 shows a schematic diagram of the process of the client accessing the data information in the corresponding version of HDFS according to the above-mentioned Embodiments 1 to 4. In FIG. 2, the entire large frame represents the process when the client accesses the data information in HDFS. The internal execution process, in which the default working mode of the client is working mode 2, that is, it directly accesses the data information in HDFS2.0 by default, and can access data information in HDFS1.0 forward-compatible and backward-compatible to access HDFS3 .0, so as to achieve compatible access to the forward version of HDFS (such as HDFS1.0) and backward version (such as HDFS3.0) through the same client, so there is no need to use the same machine. For each version of HDFS, deploy the corresponding version of the client, for example, deploy the corresponding client 1.0 for HDFS1.0, or deploy the corresponding client 2.0 for HDFS2.0.

Further, the technical solutions in the above-mentioned Embodiments 1 to 4 can be summarized as: by introducing a new implementation class SpinnerFileSystem (that is, the above-mentioned preset file system plug-in) of FileSystem (that is, the above-mentioned file system), corresponding different versions are realized. Compatible with HDFS access, the specific policies are as follows:

(1) Configure different versions of HDFS through ViewFs (view file system), wherein different versions of HDFS use different Schemas (ie, the above working modes).

(2) Configure the corresponding implementation of SpinnerFileSystem for the schema of HDFS to be compatible.

(3) In SpinnerFileSystem, through different ClassLoaders (that is, the above-mentioned class loader), the implementation JAR package (that is, the above-mentioned Java archive file package) corresponding to different versions of HDFS is loaded according to the Schema through reflection, so as to There is a version of the method interface implementation, which is passed to the corresponding version of the JAR through reflection to realize the client's access logic, serialization and RPC (Remote Procedure Call Protocol) to HDFS1.0, HDFS3.0, etc. Compatible with the framework.

Embodiment 5

FIG. 3 is a schematic structural diagram of a data access apparatus provided by an embodiment of the present application. As shown in FIG. 3 , the apparatus 30 may include a determination module 31 and a first processing module 32; wherein,

The determining module 31 is configured to determine the working mode corresponding to the currently obtained access path based on the first preset correspondence between the access path and the working mode;

The first processing module 32 is configured to access the data information in the file system of the corresponding version according to the working mode through the preset file system plug-in when the working mode is not the preset working mode.

Specifically, a first configuration module 33 is further included, as shown in FIG. 4 , wherein the first configuration module 33 is configured to configure the second preset correspondence between the working mode and the version information of the file system.

Further, the first processing module 32 includes a version determination sub-module 321 and a data access sub-module 322, as shown in FIG. 4 , wherein,

The version determination submodule 321 is configured to determine the version information of the file system corresponding to the working mode according to the second preset correspondence;

The data access sub-module 322 is configured to access the data information in the corresponding file system through the preset file system plug-in and according to the determined version information.

Further, a second configuration module 34 is also included, as shown in FIG. 4 , wherein the second configuration module 34 is configured to configure the third preset correspondence between the working mode and the class loader.

Further, the data access submodule 322 includes a class loader determination subunit 3221, a loading subunit 3222 and a data access subunit 3223, as shown in FIG. 4, wherein,

The class loader determination subunit 3221 is configured to determine the class loader corresponding to the working mode according to the third preset correspondence;

The loading subunit 3222 is used to load the Java archive file package of the file system corresponding to the version information according to the determined class loader through the preset file system plug-in;

The data access subunit 3223 is used to access data information in the file system according to the Java archive file package.

Further, the loading subunit 3221 is specifically used for the class loader to load the Java archive file package of the file system corresponding to the version information by means of reflection.

Further, it also includes a second processing module 35, as shown in FIG. 4, wherein the second acquisition module 35 is used to directly load the corresponding version information according to the second preset corresponding relationship when the working mode is the preset working mode. A Java archive file package for a file system to access data information in that file system.

Further, the file system is a distributed file system HDFS.

Compared with the prior art, the apparatus provided by the embodiment of the present application determines the working mode corresponding to the currently obtained access path based on the first preset correspondence between the access path and the working mode, and obtains the corresponding working mode according to the working mode in the future. The data information in the file system of the version provides the premise guarantee; when the working mode is not the preset working mode, the data information in the file system of the corresponding version is processed according to the working mode through the preset file system plug-in, so that it can be based on the same client The client can access any version of the file system through the preset file system plug-in, that is, in the case of being transparent to the upper-layer application, the access compatibility of the file systems of various versions through the same client is realized, which not only effectively avoids the need to pass the corresponding The tedious operation of the version of the client to access its corresponding file system, and in the process of achieving compatible access, there is no need to copy the data in other versions of the file system to the current version of the file system, reducing operational complexity and improving data access efficiency. .

Embodiment 6

An embodiment of the present application provides an electronic device. As shown in FIG. 5 , the electronic device 500 shown in FIG. 5 includes: a processor 501 and a memory 503 . The processor 501 is connected to the memory 503 , for example, through a bus 502 . Further, the electronic device 500 may also include a transceiver 504 . It should be noted that in practical applications, the transceiver 504 is not limited to one, and the structure of the electronic device 500 does not constitute a limitation to the embodiments of the present application.

The processor 501 is used in the embodiment of the present application to implement the functions of the determination module and the first processing module shown in FIG. 3 or FIG. 4 , and the first configuration module, the second configuration module and the The function of the second processing module.

The processor 501 may be a CPU, a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure. The processor 501 can also be a combination that realizes computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The bus 502 may include a path to communicate information between the components described above. The bus 502 may be a PCI bus, an EISA bus, or the like. The bus 502 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 5, but it does not mean that there is only one bus or one type of bus.

The memory 503 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or EEPROM, CD-ROM or other optical disk storage, optical disk storage. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or capable of carrying or storing desired program code in the form of instructions or data structures and capable of being executed by a computer Access any other medium without limitation.

The memory 503 is used for storing application program codes for executing the solution of the present application, and the execution is controlled by the processor 501 . The processor 501 is configured to execute the application program code stored in the memory 503, so as to realize the action of the data access apparatus provided by the embodiment shown in FIG. 3 or FIG. 4 .

The electronic device provided by the embodiments of the present application includes a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the program, compared with the prior art, it can realize: based on the access path and the The first preset correspondence between the working modes determines the working mode corresponding to the currently obtained access path, and provides a prerequisite for the subsequent acquisition of data information in the corresponding version of HDFS according to the working mode; when the working mode is not the preset working mode When the file system is preset, the data information in the corresponding version of the file system can be processed according to the working mode, so that any version of the file system can be accessed based on the same client through the preset file system plug-in. In the case of being transparent to the upper-layer application, the access compatibility of the file systems of various versions through the same client is realized, which not only effectively avoids the tedious operation of accessing the corresponding file system through the client of the corresponding version, but also realizes the compatible access. In the process, there is no need to copy the data in the file system of other versions to the file system of the current version, which reduces the operation complexity and improves the data access efficiency.

An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the method shown in the first embodiment is implemented. Compared with the prior art, based on the first preset correspondence between the access path and the working mode, the working mode corresponding to the currently obtained access path is determined, and the data information in the file system of the corresponding version is subsequently obtained according to the working mode. Provide prerequisite guarantee; when the working mode is not the preset working mode, the data information in the file system of the corresponding version can be processed according to the working mode through the preset file system plug-in, so that it can be based on the same client, through the preset file system plug-in , to access any version of the file system, that is, in the case of being transparent to the upper-layer application, it realizes the access compatibility of each version of the file system through the same client, which not only effectively avoids the corresponding version of the client to access the corresponding file system. The tedious operation of the file system, and in the process of realizing compatible access, there is no need to copy the data in the file system of other versions to the file system of the current version, which reduces the operation complexity and improves the data access efficiency.

The computer-readable storage medium provided by the embodiment of the present application is applicable to any embodiment of the foregoing method. It is not repeated here.

It should be understood that although the various steps in the flowchart of the accompanying drawings are sequentially shown in the order indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order and may be performed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution sequence is also It does not have to be performed sequentially, but may be performed alternately or alternately with other steps or at least a portion of sub-steps or stages of other steps.

The above are only part of the embodiments of the present application. It should be pointed out that for those skilled in the art, without departing from the principles of the present application, several improvements and modifications can also be made. It should be regarded as the protection scope of this application.

Claims (10)

1. A method of data access, comprising:

determining a working mode corresponding to the currently acquired access path based on a first preset corresponding relation between the access path and the working mode;

and if the working mode is not the preset working mode, accessing the data information in the file system of the corresponding version according to the working mode through a preset file system plug-in.

2. The method according to claim 1, before accessing data information in a file system of a corresponding version according to the working mode through a preset file system plug-in, further comprising:

and configuring a second preset corresponding relation between the working mode and the version information of the file system.

3. The method according to claim 2, wherein the accessing data information in the file system of the corresponding version according to the working mode through a preset file system plug-in comprises:

determining version information of the file system corresponding to the working mode according to the second preset corresponding relation;

and accessing data information in the corresponding file system according to the version information obtained by determining through a preset file system plug-in.

4. The method according to claim 3, before accessing the data information in the corresponding file system according to the determined version information through the preset file system plug-in, further comprising:

and configuring a third preset corresponding relation between the working mode and the class loader.

5. The method of claim 4, wherein accessing the data information in the corresponding file system according to the determined version information by presetting a file system plug-in comprises:

determining a class loader corresponding to the working mode according to the third preset corresponding relation;

loading a Java archive file package of the file system corresponding to the version information according to the determined class loader through the preset file system plug-in;

and accessing data information in the file system according to the Java archive file package.

6. The method according to claim 5, wherein the class loader loads the Java archive package of the file system corresponding to the version information in a reflective manner.

7. The method of any one of claims 1-6, further comprising:

and if the working mode is the preset working mode, directly loading the Java archive file packet of the file system with the corresponding version information according to the second preset corresponding relation so as to access the data information in the file system.

8. A data acquisition apparatus, comprising:

the determining module is used for determining a working mode corresponding to the currently acquired access path based on a first preset corresponding relation between the access path and the working mode;

and the first processing module is used for accessing the data information in the file system of the corresponding version according to the working mode through a preset file system plug-in when the working mode is not the preset working mode.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the data access method of any one of claims 1-7 when executing the program.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the data access method according to any one of claims 1 to 7.