This is an old revision of the document!
Table of Contents
Old Hardware
- AMD Athlon 64 X2 6000+ 3.0GHz 125W
- 8GB DDR3
New Hardware
- AMD Ryzen 1600 3.2GHz 65W
- 32GB DDR4 2400
- APC BN700MC Back-UPS 700 VA (420W)
- ATI Radeon X600 ($4.99 cheap PCIe graphics card)
Configurations
Ubuntu Server 17.04 (US)
- Kernel version 4.10
- gcc version 6.3.0
Fedora Server 26 (FS)
- Kernel version 4.11.9
- gcc version 7.1.1
Benchmarks
| Test | Old | New (US) | New (FS) |
|---|---|---|---|
| Idle Power | 65W | 56W (w/ video card) | |
| Full Load Power | 187W | 132W | |
| dd if=/dev/urandom of=outfile bs=1000000 count=1000 | 1m1.045s (16.4 MB/s) | 14.425s (69.3 MB/s) | 14.543s (68.8 MB/s) |
| dd if=outfile of=/dev/null bs=1000000 (after reboot to clear disk cache) | 6.556s (153 MB/s) | 1.058s (947 MB/s) | 0.944s (1.1 GB/s) |
| Phoronix ramspeed (Average, Integer) | 2988.37 MB/s | won't compile | won't compile |
| Phoronix ramspeed (Average, Floating Point) | 3149.90 MB/s | won't compile | won't compile |
| Phoronix aio-stress | 682.69 MB/s | 2713.93 MB/s | 2675.22 MB/s |
| Phoronix n-queens | 136.92s | 24.81s | 22.86s |
Bonnie++ in a VM
Command:
bonnie++ -s 3g
Executed on a VM with 768MB of RAM.
Old Hardware
ide interface
Version 1.97 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hathor 3G 748 98 85183 23 63873 27 2543 96 295344 57 1971 195
Latency 23852us 9710ms 6711ms 9268us 10251us 43389us
Version 1.97 ------Sequential Create------ --------Random Create--------
hathor -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 15314us 591us 778us 3577us 913us 217us
1.97,1.97,hathor,1,1499995713,3G,,748,98,85183,23,63873,27,2543,96,295344,57,1971,195,16,,,,,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,23852us,9710ms,6711ms,9268us,10251us,43389us,15314us,591us,778us,3577us,913us,217us
virtio interface
Version 1.97 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hathor 3G 752 97 100045 19 97967 23 2584 98 737193 70 3204 57
Latency 30917us 656ms 235ms 9763us 4836us 7188us
Version 1.97 ------Sequential Create------ --------Random Create--------
hathor -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 9398us 595us 647us 1329us 48us 226us
1.97,1.97,hathor,1,1499994609,3G,,752,97,100045,19,97967,23,2584,98,737193,70,3204,57,16,,,,,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,30917us,656ms,235ms,9763us,4836us,7188us,9398us,595us,647us,1329us,48us,226us
New Hardware (FS)
virtio interface
Version 1.97 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
hathor 3G 1591 99 195864 9 192590 10 +++++ +++ 2287940 56 +++++ +++
Latency 13792us 3537us 3623us 3168us 1356us 1846us
Version 1.97 ------Sequential Create------ --------Random Create--------
hathor -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 2731us 267us 257us 122us 25us 122us
1.97,1.97,hathor,1,1500205275,3G,,1591,99,195864,9,192590,10,+++++,+++,2287940,56,+++++,+++,16,,,,,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,13792us,3537us,3623us,3168us,1356us,1846us,2731us,267us,257us,122us,25us,122us
Issues
APC UPS not killing power
I think this is a Fedora / systemd problem. apcupsd will detect the AC power failure and initiate a shutdown (shutdown -h -H now via apccontrol). But apccontrol killpower does not seem to be called. Also, during shutdown, systemd reports “A stop job is running for APC UPS Power Control Daemon for Linux”. Not sure if this is because the apcupsd service was what kicked off the shutdown command, so it wasn't able to be stopped.
Bug report filed: https://bugzilla.redhat.com/show_bug.cgi?id=1472062 Problem of not cutting UPS power seems to be due to /etc/apcupsd/powerfail file not getting created which might be because of SELinux. Other part of the problem (hanging on stopping the apcupsd service) still remains but is worked around by changing the service timeout to 10s.
Installation
- Install base F26 server.
dnf updatednf install \ vim \ qemu-system-x86 \ qemu-kvm \ apcupsd \ nfs-utils \ libvirt-daemon-qemu \ libvirt-client \ ssmtp
- Edit
/etc/default/grub:- Remove
rhgb - Decrease timeout
grub2-mkconfig -o /boot/efi/EFI/fedora/grub.cfg- Add
/etc/sysconfig/network-scripts/ifcfg-br0:DEVICE=br0 TYPE=Bridge DELAY=0 NM_CONTROLLED=no ONBOOT=yes BOOTPROTO=static IPADDR=192.168.16.20 NETMASK=255.255.255.0 GATEWAY=192.168.16.1
- In
/etc/sysconfig/network-scripts/ifcfg-enp7s0, changeBOOTPROTOtonone, and addBRIDGE=br0andNM_CONTROLLED=no chkconfig network on- edit
/etc/apcupsd/apcupsd.confand/etc/apcupsd/apccontrol systemctl enable apcupsd.servicesystemctl enable libvirt-guestssystemctl enable nfs-server.servicesystemctl enable rpcbindfirewall-cmd –add-service=nfs –permanent- Do fixes in https://bugzilla.redhat.com/show_bug.cgi?id=1472062 (disable SELinux and reduce stop timeout of apcupsd service to 10s) to allow apcupsd to work properly
- Configure ssmtp in
/etc/ssmtp/ssmtp.conf
Services
| Server | Services | OS |
|---|---|---|
| anubis (host) |
| Fedora Server 26 |
| oneill (VM) |
| Ubuntu Server 16.04 |
| carter (VM) |
| Ubuntu Server 16.04 |
| baal (VM) |
| Fedora Server 26 |
| hathor (VM) |
| Ubuntu Server 16.04 |
| ra (VM) |
| Mythbuntu 16.04 |
