Configuration Properties


CephBroker.MonAddr

Ceph monitor address to connect to


CephBroker.Port

Port number on which to listen (read by CephBroker only)


CephBroker.Workers

Number of Ceph broker worker threads created, maybe

Default Value:  20


Comm.DispatchDelay

[TESTING ONLY] Delay dispatching of read requests by this number of milliseconds

Default Value:  0


Comm.UsePoll

Use poll() interface

Default Value:  false


FsBroker.DisableFileRemoval

Rename files with .deleted extension instead of removing (for testing)

Default Value:  false


FsBroker.Hdfs.NameNode.Host

Name of host on which HDFS NameNode is running (NOTE: this property is deprecated, use HdfsBroker.Hadoop.ConfDir instead)

Default Value:  default


FsBroker.Hdfs.NameNode.Port

Port number on which HDFS NameNode is running (NOTE: this property is deprecated, use HdfsBroker.Hadoop.ConfDir instead)

Default Value:  0


FsBroker.Host

Host on which the FS broker is running (read by clients only)

Default Value:  localhost


FsBroker.Local.DirectIO

Read and write files using direct i/o

Default Value:  false


FsBroker.Local.Port

Port number on which to listen (read by LocalBroker only)

Default Value:  15863


FsBroker.Local.Reactors

Number of local broker communication reactor threads created


FsBroker.Local.Root

Root of file and directory hierarchy for local broker (if relative path, then is relative to the Hypertable data directory root)


FsBroker.Local.Workers

Number of local broker worker threads created

Default Value:  20


FsBroker.Port

Port number on which FS broker is listening (read by clients only)

Default Value:  15863


FsBroker.Timeout

Length of time, in milliseconds, to wait before timing out FS Broker requests. This takes precedence over Hypertable.Request.Timeout


HdfsBroker.Hadoop.ConfDir

Hadoop configuration directory (e.g. /etc/hadoop/conf or /usr/lib/hadoop/conf)


HdfsBroker.Port

Port number on which to listen (read by HdfsBroker only)


HdfsBroker.Reactors

Number of HDFS broker communication reactor threads created


HdfsBroker.SyncBlock

Pass SYNC_BLOCK flag to Filesystem.create() when creating files

Default Value:  true


HdfsBroker.Workers

Number of HDFS broker worker threads created


HdfsBroker.fs.default.name

Hadoop Filesystem default name, same as fs.default.name property in Hadoop config (e.g. hdfs://localhost:9000) (NOTE: this property is deprecated, use HdfsBroker.Hadoop.ConfDir instead)


Hyperspace.Checkpoint.Size

Run BerkeleyDB checkpoint when logs exceed this size limit

Default Value:  1000000


Hyperspace.Client.Datagram.SendPort

Client UDP send port for keepalive packets

Default Value:  0


Hyperspace.GracePeriod

Hyperspace Grace period (see Chubby paper)

Default Value:  60000


Hyperspace.KeepAlive.Interval

Hyperspace Keepalive interval (see Chubby paper)

Default Value:  10000


Hyperspace.Lease.Interval

Hyperspace Lease interval (see Chubby paper)

Default Value:  60000


Hyperspace.LogGc.Interval

Check for unused BerkeleyDB log files after this much time

Default Value:  60000


Hyperspace.LogGc.MaxUnusedLogs

Number of unused BerkeleyDB to keep around in case of lagging replicas

Default Value:  200


Hyperspace.Maintenance.Interval

Hyperspace maintenance interval (checkpoint BerkeleyDB, log cleanup etc)

Default Value:  60000


Hyperspace.Replica.Dir

Root of hyperspace file and directory heirarchy in local filesystem (if relative path, then is relative to the Hypertable data directory root)


Hyperspace.Replica.Host

Hostname of Hyperspace replica


Hyperspace.Replica.Port

Port number on which Hyperspace is or should be listening for requests

Default Value:  15861


Hyperspace.Replica.Reactors

Number of Hyperspace Master communication reactor threads created


Hyperspace.Replica.Replication.Port

Hyperspace replication port

Default Value:  15862


Hyperspace.Replica.Replication.Timeout

Hyperspace replication master dies if it doesn't receive replication acknowledgement within this period

Default Value:  10000


Hyperspace.Replica.Workers

Number of Hyperspace Replica worker threads created

Default Value:  20


Hyperspace.Session.Reconnect

Reconnect to Hyperspace on session expiry

Default Value:  false


Hyperspace.Timeout

Timeout (millisec) for hyperspace requests (preferred to Hypertable.Request.Timeout

Default Value:  30000


Hypertable.Client.Workers

Number of client worker threads created

Default Value:  20


Hypertable.Cluster.Name

Name of cluster used in Monitoring UI and admin notification messages


Hypertable.CommitLog.Compressor

Commit log compressor to use (zlib, lzo, quicklz, snappy, bmz, none)

Default Value:  quicklz


Hypertable.CommitLog.RollLimit

Roll commit log (close current fragment file and create a new one) after writing this many bytes

Default Value:  100000000


Hypertable.CommitLog.SkipErrors

Skip over any corruption encountered in the commit log

Default Value:  false


Hypertable.Connection.Retry.Interval

Average time, in milliseconds, between connection retry atempts

Default Value:  10000


Hypertable.DataDirectory

Hypertable data directory root

Default Value:  Top-level installation directory


Hypertable.Directory

Top-level hypertable directory name

Default Value:  hypertable


Hypertable.Failover.GracePeriod

Master will wait this many milliseconds before trying to recover a RangeServer

Default Value:  30000


Hypertable.Failover.Quorum.Percentage

Percentage of live RangeServers required for failover to proceed

Default Value:  90


Hypertable.Failover.RecoverInSeries

Carry out USER log recovery for failed servers in series

Default Value:  false


Hypertable.Failover.Timeout

Timeout (milliseconds) for failover operations

Default Value:  300000


Hypertable.HqlInterpreter.Mutator.NoLogSync

Suspends CommitLog sync operation on updates until command completion

Default Value:  false


Hypertable.LoadBalancer.BalanceDelay.Initial

Amount of time (seconds) to wait after start up before running balancer

Default Value:  86400


Hypertable.LoadBalancer.BalanceDelay.NewServer

Amount of time (seconds) to wait before running balancer when a new RangeServer is detected

Default Value:  60


Hypertable.LoadBalancer.Crontab

Crontab entry to control when load balancer is run

Default Value:  0 0 * * *


Hypertable.LoadBalancer.Enable

Enable automatic load balancing

Default Value:  true


Hypertable.LoadBalancer.LoadavgThreshold

Servers with loadavg above this much above the mean will be considered by the load balancer to be overloaded

Default Value:  0.25


Hypertable.LoadMetrics.Interval

Period of time, in seconds, between writing metrics to sys/RS_METRICS

Default Value:  3600


Hypertable.LocationCache.MaxEntries

Size of range location cache in number of entries

Default Value:  1000000


Hypertable.LogFlushMethod.Meta

This is a string property that can take either the value FLUSH or SYNC. It controls the flush method for writes to the METADATA commit log. When running Hypertable on top of HDFS, a value of FLUSH causes hflush() to be used and a value of SYNC causes hsync() to be used.

Default Value:  SYNC


Hypertable.LogFlushMethod.User

This is a string property that can take either the value FLUSH or SYNC. It controls the flush method for writes to the user data commit log. When running Hypertable on top of HDFS, a value of FLUSH causes hflush() to be used and a value of SYNC causes hsync() to be used.

Default Value:  FLUSH


Hypertable.Logging.Level

Set system wide logging level (default: info)

Default Value:  info


Hypertable.Master.DiskThreshold.Percentage

Stop assigning ranges to RangeServers if disk usage is above this threshold

Default Value:  90


Hypertable.Master.Gc.Interval

Garbage collection interval in milliseconds by Master

Default Value:  300000


Hypertable.Master.Host

Host on which Hypertable Master is running


Hypertable.Master.Locations.IncludeMasterHash

Includes master hash (host:port) in RangeServer location id

Default Value:  false


Hypertable.Master.NotificationInterval

Notification interval (in seconds) of abnormal state

Default Value:  3600


Hypertable.Master.Port

Port number on which Hypertable Master is or should be listening

Default Value:  15864


Hypertable.Master.Reactors

Number of Hypertable Master communication reactor threads created


Hypertable.Master.Split.SoftLimitEnabled

Enable aggressive splitting of tables with little data to spread out ranges

Default Value:  true


Hypertable.Master.Workers

Number of Hypertable Master worker threads created

Default Value:  100


Hypertable.Metadata.Replication

Replication factor for commit log files

Default Value:  -1


Hypertable.MetaLog.HistorySize

Number of old MetaLog files to retain for historical purposes

Default Value:  30


Hypertable.MetaLog.MaxFileSize

Maximum size a MetaLog file can grow before it is compacted

Default Value:  100MB


Hypertable.MetaLog.SkipErrors

Skipping errors instead of throwing exceptions on metalog errors

Default Value:  false


Hypertable.Metrics.Ganglia.Disable

Disable publishing of metrics to Ganglia

Default Value:  false


Hypertable.Metrics.Ganglia.Port

UDP Port on which Hypertable gmond python extension module listens for metrics

Default Value:  15860


Hypertable.Monitoring.Disable

Disables the generation of monitoring statistics

Default Value:  false


Hypertable.Monitoring.Interval

Monitoring statistics gathering interval (in milliseconds)

Default Value:  30000


Hypertable.Mutator.FlushDelay

Number of milliseconds to wait prior to flushing scatter buffers (for testing)

Default Value:  0


Hypertable.Mutator.ScatterBuffer.FlushLimit.Aggregate

Amount of updates (bytes) accumulated for all servers to trigger a scatter buffer flush

Default Value:  50000000


Hypertable.Mutator.ScatterBuffer.FlushLimit.PerServer

Amount of updates (bytes) accumulated for a single server to trigger a scatter buffer flush

Default Value:  10000000


Hypertable.Network.Interface

Use this interface for network communication


Hypertable.RangeLocator.MaxErrorQueueLength

Maximum numbers of errors to be stored

Default Value:  4


Hypertable.RangeLocator.MetadataReadaheadCount

Number of rows that the RangeLocator fetches from the METADATA

Default Value:  10


Hypertable.RangeLocator.MetadataRetryInterval

Retry interval when connecting to a RangeServer to fetch metadata

Default Value:  3000


Hypertable.RangeLocator.RootMetadataRetryInterval

Retry interval when connecting to the Root RangeServer

Default Value:  3000


Hypertable.RangeServer.AccessGroup.CellCache.PageSize

Page size for CellCache pool allocator

Default Value:  524288


Hypertable.RangeServer.AccessGroup.CellCache.ScannerCacheSize

CellCache scanner cache size

Default Value:  1024


Hypertable.RangeServer.AccessGroup.GarbageThreshold.Percentage

Perform major compaction when garbage accounts for this percentage of the data

Default Value:  20


Hypertable.RangeServer.AccessGroup.MaxMemory

Maximum bytes consumed by an Access Group

Default Value:  1000000000


Hypertable.RangeServer.AccessGroup.ShadowCache

Enable CellStore shadow caching

Default Value:  false


Hypertable.RangeServer.BlockCache.Compressed

Controls whether or not block cache stores compressed blocks

Default Value:  true


Hypertable.RangeServer.BlockCache.MaxMemory

Maximum (target) size of block cache

Default Value:  -1 (all available RAM)


Hypertable.RangeServer.BlockCache.MinMemory

Minimum size of block cache

Default Value:  0


Hypertable.RangeServer.CellStore.DefaultBlockSize

Default block size for cell stores

Default Value:  65536


Hypertable.RangeServer.CellStore.DefaultBloomFilter

Default bloom filter for cell stores

Default Value:  rows


Hypertable.RangeServer.CellStore.DefaultCompressor

Default compressor for cell stores

Default Value:  snappy


Hypertable.RangeServer.CellStore.Merge.RunLengthThreshold

Trigger a merge if an adjacent run of merge candidate CellStores exceeds this length

Default Value:  5


Hypertable.RangeServer.CellStore.SkipBad

Skip over corrupt cell stores.

NOTE: This property should only be used in certain disaster recovery scenarios, such as when the filesystem has become corrupt. This property leads to leaked files and hides the extent of the data loss. It is better to manually remove corrupt files and use the Hypertable.RangeServer.CellStore.SkipNotFound to skip over them.

Default Value:  false


Hypertable.RangeServer.CellStore.SkipNotFound

Skip over cell stores that are non-existent

Default Value:  false


Hypertable.RangeServer.CellStore.TargetSize.Minimum

Merging compaction target CellStore size during normal activity period

Default Value:  10MB


Hypertable.RangeServer.CellStore.TargetSize.Maximum

Merging compaction target CellStore size during low activity period

Default Value:  50MB


Hypertable.RangeServer.ClockSkew.Max

Maximum amount of clock skew (microseconds) the system will tolerate

Default Value:  3000000


Hypertable.RangeServer.CommitInterval

Default minimum group commit interval in milliseconds

Default Value:  50


Hypertable.RangeServer.CommitLog.Compressor

Commit log compressor to use (zlib, lzo, quicklz, snappy, bmz, none)

Default Value:  quicklz


Hypertable.RangeServer.CommitLog.DfsBroker.Host

Host of FS Broker to use for Commit Log


Hypertable.RangeServer.CommitLog.DfsBroker.Port

Port of FS Broker to use for Commit Log


Hypertable.RangeServer.CommitLog.FragmentRemoval.RangeReferenceRequired

Only remove linked log fragments if they're part of a transfer log referenced by a range

Default Value:  true


Hypertable.RangeServer.CommitLog.PruneThreshold.Max

Upper threshold for amount of outstanding commit log before pruning


Hypertable.RangeServer.CommitLog.PruneThreshold.Max.MemoryPercentage

Upper threshold in terms of % RAM for amount of outstanding commit log before pruning

Default Value:  50


Hypertable.RangeServer.CommitLog.PruneThreshold.Min

Lower threshold for amount of outstanding commit log before pruning

Default Value:  1000000000


Hypertable.RangeServer.ControlFile.CheckInterval

Minimum time interval (milliseconds) to check for control files in run/ directory

Default Value:  30000


Hypertable.RangeServer.Data.DefaultReplication

Default replication for data

Default Value:  -1


Hypertable.RangeServer.Failover.FlushLimit.Aggregate

Amount of updates (bytes) accumulated for all range to trigger a replay buffer flush

Default Value:  100000000


Hypertable.RangeServer.Failover.FlushLimit.PerRange

Amount of updates (bytes) accumulated for a single range to trigger a replay buffer flu\ sh

Default Value:  10000000


Hypertable.RangeServer.IgnoreClockSkewErrors

Ignore clock skew errors

Default Value:  false


Hypertable.RangeServer.LoadSystemTablesOnly

Instructs the RangeServer to only load system tables (for debugging)

Default Value:  false


Hypertable.RangeServer.LowMemoryLimit.Percentage

Amount of memory to free in low memory condition as percentage of RangeServer memory limit

Default Value:  10


Hypertable.RangeServer.LowActivityPeriod

Crontab-style entry specifying the low activity period. This property can be specified multiple times to specify multiple low activity periods.  The RangeServer performs more aggressive maintenance during this period.

Default Value:  * 2-4 * * *


Hypertable.RangeServer.Maintenance.Interval

Maintenance scheduling interval in milliseconds

Default Value:  30000


Hypertable.RangeServer.Maintenance.LowMemoryPrioritization

Use low memory prioritization algorithm for freeing memory in low memory mode

Default Value:  true


Hypertable.RangeServer.Maintenance.MaxAppQueuePause

Each time application queue is paused, keep it paused for no more than this many milliseconds

Default Value:  120000


Hypertable.RangeServer.Maintenance.MergesPerInterval

Limit on number of merging tasks to create per maintenance interval


Hypertable.RangeServer.Maintenance.MergingCompaction.Delay

Millisecond delay before scheduling merging compactions in non-low memory mode

Default Value:  900000


Hypertable.RangeServer.Maintenance.MoveCompactionsPerInterval

Limit on number of major compactions due to move per maintenance interval

Default Value:  2


Hypertable.RangeServer.Maintenance.InitializationPerInterval

Limit on number of initialization tasks to create per maintenance interval


Hypertable.RangeServer.MaintenanceThreads

Number of maintenance threads. Default is max(1.5*drive-count, number-of-cores).


Hypertable.RangeServer.MemoryLimit

Absolute RangeServer memory limit


Hypertable.RangeServer.MemoryLimit.EnsureUnused

Amount of unused physical memory


Hypertable.RangeServer.MemoryLimit.EnsureUnused.Percentage

Amount of unused physical memory specified as percentage of physical RAM


Hypertable.RangeServer.MemoryLimit.Percentage

RangeServer memory limit specified as percentage of physical RAM

Default Value:  60


Hypertable.RangeServer.Monitoring.DataDirectories

Comma-separated list of directory mount points of disk volumes to monitor

Default Value:  /


Hypertable.RangeServer.Port

Port number on which range servers are or should be listening

Default Value:  15865


Hypertable.RangeServer.ProxyName

Use this value for the proxy name (if set) instead of reading from run dir.

Default Value:


Hypertable.RangeServer.QueryCache.EnableMutexStatistics

Enables waiter statistics on query cache mutex

Default Value:  true


Hypertable.RangeServer.QueryCache.MaxMemory

Maximum size of query cache

Default Value:  50000000


Hypertable.RangeServer.Range.MaximumSize

Maximum size of a range in bytes before updates get throttled

Default Value:  3000000000


Hypertable.RangeServer.Range.MetadataSplitSize

Size of METADATA range in bytes before splitting (for testing)


Hypertable.RangeServer.Range.RowSize.Unlimited

Marks range active and unsplittable upon encountering row overflow condition. Can cause ranges to grow extremely large. Use with caution!

Default Value:  false


Hypertable.RangeServer.Range.SplitOff

Portion of range to split off (high or low)

Default Value:  high


Hypertable.RangeServer.Range.SplitSize

Size of range in bytes before splitting

Default Value:  536870912


Hypertable.RangeServer.Range.RowSize.Unlimited

Marks range active and unsplittable upon encountering row overflow condition. Can cause ranges to grow extremely large. Use with caution!

Default Value:  false


Hypertable.RangeServer.Reactors

Number of Range Server communication reactor threads created


Hypertable.RangeServer.ReadyStatus

Status code indicating RangeServer is ready for operation. By setting this property to OK the RangeServer startup script will wait until all deferred initialization (loading of CellStores) is complete, before returning.

Default Value:  WARNING


Hypertable.RangeServer.Scanner.BufferSize

Size of transfer buffer for scan results

Default Value:  1000000


Hypertable.RangeServer.Scanner.Ttl

Number of milliseconds of inactivity before destroying scanners

Default Value:  1800000


Hypertable.RangeServer.Testing.MaintenanceNeeded.PauseInterval

TESTING: After update, if range needs maintenance, pause for this number of milliseconds

Default Value:  0


Hypertable.RangeServer.Timer.Interval

Timer interval in milliseconds (reaping scanners, purging commit logs, etc.)

Default Value:  20000


Hypertable.RangeServer.UpdateCoalesceLimit

Amount of update data to coalesce into single commit log sync

Default Value:  5000000


Hypertable.RangeServer.UpdateDelay

Number of milliseconds to wait before carrying out an update (TESTING)

Default Value:  0


Hypertable.RangeServer.Workers

Number of Range Server worker threads created

Default Value:  50


Hypertable.Request.Timeout

Length of time, in milliseconds, before timing out requests (system wide)

Default Value:  600000


Hypertable.Scanner.QueueSize

Size of Scanner ScanBlock queue

Default Value:  5


Hypertable.Silent

Disable verbose output (system wide)

Default Value:  false


Hypertable.Verbose

Enable verbose output (system wide)

Default Value:  false


Qfs.Broker.Reactors

Number of QFS broker reactor threads


Qfs.Broker.Workers

Number of worker threads for QFS broker

Default Value:  20


Qfs.MetaServer.Name

Hostname of QFS meta server

Default Value:  localhost


Qfs.MetaServer.Port

Port number for QFS meta server

Default Value:  20000


ThriftBroker.API.Logging

Enable or disable Thrift API logging

Default Value:  false


ThriftBroker.Future.Capacity

Capacity of result queue (in bytes) for Future objects

Default Value:  50000000


ThriftBroker.Hyperspace.Session.Reconnect

ThriftBroker will reconnect to Hyperspace on session expiry

Default Value:  true


ThriftBroker.Mutator.FlushInterval

Maximum flush interval in milliseconds

Default Value:  1000


ThriftBroker.NextThreshold

Total size threshold for (size of cell data) for thrift broker next calls

Default Value:  512000


ThriftBroker.Port

Port number for thrift broker

Default Value:  15867


ThriftBroker.SlowQueryLog.Enable

Enable slow query logging

Default Value:  false


ThriftBroker.SlowQueryLog.LatencyThreshold

Latency threshold (ms) above which a query is considered slow

Default Value:  10000


ThriftBroker.Timeout

Timeout (ms) for thrift broker


ThriftBroker.Workers

Number of worker threads for thrift broker

Default Value:  50