January 23, 2012
Evaluator: Christoph Rupp
Hostname(s) |
Service |
Machine Configuration |
master001-01 |
NameNode |
CPU: Intel(R) Xeon(R) CPU cores: 8 arch: x86_64 RAM: 32 GB OS: CentOS 6.1 Kernel:
Linux 2.6.32-71.el6.x86_64 |
hyperspace01-01 |
Master |
CPU: Intel(R) Xeon(R) CPU
X5470 @ 3.33GHz cores: 8 arch: x86_64 RAM: 16 GB OS: CentOS 6.1 kernel:
Linux 2.6.32-71.el6.x86_64 |
slave001-01
.. slave001-08, slave002-01
.. slave002-08 |
DataNode |
CPU: Intel(R) Xeon(R) CPU
E5506 @ 2.13GHz cores: 8 arch: x86_64 RAM: 24 GB OS: CentOS 6.1 kernel:
Linux 2.6.32-71.el6.x86_64 disk: 6X1TB, /data01 É /data06 use: 7-12% |
secondary001-01 |
Secondary
NameNode |
CPU: Intel(R) Xeon(R) CPU
E5540 @ 2.53GHz cores: 16 arch: x86_64 RAM: 38 GB OS: CentOS 6.1 kernel:
Linux 2.6.32-71.el6.x86_64 |
secondary001-01 |
Secondary
NameNode |
CPU: Intel(R) Xeon(R) CPU
X5470 @ 3.33GHz cores: 8 arch: x86_64 RAM: 16 GB OS: CentOS 6.1 kernel:
Linux 2.6.32-71.el6.x86_64 |
slave001-* machines are plugged into one switch
slave002-* machines are plugged into second switch
Both switches are wire speed and there is a 10Gbps link between the switches.
hdfs-site.xml:
<property>
<name>dfs.http.address</name>
<value>master001-01.samplecustomer.com:50070</value>
</property>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>
<property>
<name>dfs.block.size</name>
<value>134217728</value>
</property>
Non-standard config:
Hypertable.RangeServer.Range.SplitSize=268435456
Hypertable.Mutator.ScatterBuffer.FlushLimit.PerServer=10485760
Hypertable.RangeServer.CommitLog.PruneThreshold.Min=1000000000
Hypertable.RangeServer.CommitLog.PruneThreshold.Max=3000000000
Hypertable.RangeServer.CellStore.DefaultBlockSize=32768
Hypertable.RangeServer.MemoryLimit=11G
Hypertable.RangeServer.Workers=200
Hypertable.RangeServer.Reactors=24
Hypertable.RangeServer.Scanner.Ttl=300000
ThriftBroker.API.Logging=1
Hypertable.Logging.Level=warn
Python Thrift Client interface.