core-site
Contents
name | value | description | desc |
---|---|---|---|
dfs.ha.fencing.methods | List of fencing methods to use for service fencing. May contain builtin methods (eg shell and sshfence) or user-defined method. | 用途:确保原来的 Active NameNode 被安全地隔离,从而避免数据不一致或“脑裂”(split-brain)问题 | |
fs.client.resolve.topology.enabled | FALSE | Whether the client machine will use the class specified by property net.topology.node.switch.mapping.impl to compute the network distance between itself and remote machines of the FileSystem. Additional properties might need to be configured depending on the class specified in net.topology.node.switch.mapping.impl. For example, if org.apache.hadoop.net.ScriptBasedMapping is used, a valid script file needs to be specified in net.topology.script.file.name. | |
fs.defaultFS | file:/// | The name of the default file system. | |
fs.permissions.umask-mode | 22 | The umask used when creating files and directories. | |
fs.protected.directories | A comma-separated list of directories which cannot be deleted even by the superuser unless they are empty. This setting can be used to guard important system directories against accidental deletion due to administrator error. | ||
fs.trash.checkpoint.interval | 0 | Number of minutes between trash checkpoints. Should be smaller or equal to fs.trash.interval. If zero, the value is set to the value of fs.trash.interval. Every time the checkpointer runs it creates a new checkpoint out of current and removes checkpoints created more than fs.trash.interval minutes ago. | 定期将 Current 回收站目录归档到带时间戳的目录(如 /.Trash/20240101 ) |
fs.trash.interval | 0 | Number of minutes after which the checkpoint gets deleted. If zero, the trash feature is disabled. This option may be configured both on the server and the client. If trash is disabled server side then the client side configuration is checked. If trash is enabled on the server side then the value configured on the server is used and the client configuration value is ignored. | |
ha.zookeeper.quorum | A list of ZooKeeper server addresses, separated by commas, that are to be used by the ZKFailoverController in automatic failover. | ||
hadoop.http.authentication.simple.anonymous.allowed | TRUE | Indicates if anonymous requests are allowed when using ‘simple’ authentication. | |
hadoop.http.authentication.type | simple | Defines authentication used for Oozie HTTP endpoint. Supported values are: simple | kerberos | #AUTHENTICATION_HANDLER_CLASSNAME# | |
hadoop.http.filter.initializers | org.apache.hadoop.http.lib.StaticUserWebFilter | A comma separated list of class names. Each class in the list must extend org.apache.hadoop.http.FilterInitializer. The corresponding Filter will be initialized. Then, the Filter will be applied to all user facing jsp and servlet web pages. The ordering of the list defines the ordering of the filters. | |
hadoop.http.logs.enabled | TRUE | Enable the “/logs” endpoint on all Hadoop daemons, which serves local logs, but may be considered a security risk due to it listing the contents of a directory. | |
hadoop.http.staticuser.user | dr.who | The user name to filter as, on static web filters while rendering content. An example use is the HDFS web UI (user to be used for browsing files). | |
hadoop.security.auth_to_local | Maps kerberos principals to local user names | ||
hadoop.security.authentication | simple | Possible values are simple (no authentication), and kerberos | |
hadoop.security.group.mapping | org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback | Class for user to group mapping (get groups for a given user) for ACL. The default implementation, org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback, will determine if the Java Native Interface (JNI) is available. If JNI is available the implementation will use the API within hadoop to resolve a list of groups for a user. If JNI is not available then the shell implementation, ShellBasedUnixGroupsMapping, is used. This implementation shells out to the Linux/Unix environment with the bash -c groups command to resolve a list of groups for a user. | |
hadoop.security.group.mapping.providers | Comma separated of names of other providers to provide user to group mapping. Used by CompositeGroupsMapping. | ||
hadoop.security.impersonation.provider.class | A class which implements ImpersonationProvider interface, used to authorize whether one user can impersonate a specific user. If not specified, the DefaultImpersonationProvider will be used. If a class is specified, then that class will be used to determine the impersonation capability. | ||
hadoop.tmp.dir | /tmp/hadoop-${user.name} | A base for other temporary directories. | |
hadoop.user.group.static.mapping.overrides | dr.who=; | Static mapping of user to groups. This will override the groups if available in the system for the specified user. In other words, groups look-up will not happen for these users, instead groups mapped in this configuration will be used. Mapping should be in this format. user1=group1,group2;user2=;user3=group2; Default, “dr.who=;” will consider “dr.who” as user without groups. | |
hadoop.user.group.static.mapping.overrides | dr.who=; | Static mapping of user to groups. This will override the groups if available in the system for the specified user. In other words, groups look-up will not happen for these users, instead groups mapped in this configuration will be used. Mapping should be in this format. user1=group1,group2;user2=;user3=group2; Default, “dr.who=;” will consider “dr.who” as user without groups. | |
net.topology.node.switch.mapping.impl | org.apache.hadoop.net.ScriptBasedMapping | The default implementation of the DNSToSwitchMapping. It invokes a script specified in net.topology.script.file.name to resolve node names. If the value for net.topology.script.file.name is not set, the default value of DEFAULT_RACK is returned for all node names. | |
net.topology.script.file.name | The script name that should be invoked to resolve DNS names to NetworkTopology names. Example: the script would take host.foo.bar as an argument, and return /rack1 as the output. | ||
net.topology.script.number.args | 100 | The max number of args that the script configured with net.topology.script.file.name should be run with. Each arg is an IP address. | |
net.topology.table.file.name | The file name for a topology file, which is used when the net.topology.node.switch.mapping.impl property is set to org.apache.hadoop.net.TableMapping. The file format is a two column text file, with columns separated by whitespace. The first column is a DNS or IP address and the second column specifies the rack where the address maps. If no entry corresponding to a host in the cluster is found, then /default-rack is assumed. |