Recently I built and set up a new ClearOS machine. ClearOS is an open-sourced router and server distro based on CentOS, the free version of Red Hat Linux.
The machine is based on an Intel Atom 330 (dual-core 1.6Ghz) with 2Gb of DDR2 800Mhz RAM. It has one onboard Realtek 8168B PCIe gigabit ethernet controller (LAN side) and I have installed a VIA Rhine II 100Mbit PCI network card (PPPoE/WAN side). I have also installed a Marvell 88SE9123 PCIe SATA 6.0 Gb/s SATA controller and a Silicon Image SiI 3114 3Gb/s SATA controller for extra hard disks. The Marvell chip on the former card is the same one installed on many new motherboards which boast SATA3 support, and will be until Intel, AMD, VIA et. al. start incorporating SATA3 controllers into their chipsets, so it is already well supported and will be for some time. It is only a 2-port card but that is perfect for RAID0 or RAID1 configuration, not that I am using the fakeraid hardware controller on board.
So far the system has had several teething problems. I am using a standard Billion 7300 modem/router as a simple ADSL2+ bridge, with the ClearOS box performing PPPoE negotiation and all routing (NAT) duties. I have left my previous modem/router, a Billion 7404VGPX configured and connected to the LAN on standby duty in case I have problems with ClearOS, which I have. All I need to do is move the phone line from the Billion 7300 to the 7404 and re-enable the DHCP server on the 7404 to revert to the old setup.
The ClearOS installation procedure is fairly straightfoward although it is somewhat limited by the fact that you must install from USB or CDROM if you are setting up ClearOS in Gateway mode like I have done. You cannot do an install from the internet unless you are running standalone mode. This doesn’t really make sense to me, surely it wouldn’t be hard to specify temporary network settings during the installation procedure to gain access to the internet?
Some of the problems I have had so far with ClearOS:
- Hard locks (hardware problems): the Sil 3114 card has caused some hard system locks while accessing attached disks. Considering this card has been in use for the last 3-4 years in an older fileserver with four disks attached (it now only has two), this is either indicative of the card reaching its end of life, a problem with its physical installation or some incompatibility between this and the motherboard. The latter is highly unlikely, but the former are possible. That said, it has been working well for the entire time in a well-ventilated case and is essentially ‘good as new’, so who really knows? I have reseated the card in the PCI slot and so far the system has been operating for 25 hours straight. Still early days, but previously it’d only worked for less than that before problems arose.
- Soft locks (software problems): I have managed to lock the system two or three times by clicking around the web control panel. It seems as though running certain reports causes catastrophic failures somewhere, so much so that it ceases function as a router and does not even respond to SSH any longer, requiring a hard reset. This has not happened since I reseated the Sil 3114 card though, so maybe that was at play here.
- Random service failures: the web configuration sometimes dies and comes back. Usually after performing a CPU-intensive task, like listing the currently open connections or generating a report.
- PPPoE: doesn’t seem to receive DNS server address information from the ISP. Or if it does, it doesn’t redistribute this information via DHCP automatically. I’ve had to manually input the preferred DNS servers into the DHCP client.
- ClearOS doesn’t support transparent web proxying AND QoS bandwidth allocation. This is a well-discussed problem with ClearOS, apparently the developers think the problem is too hard to solve without more money. However, other freely-available Linux-based routers can do transparent web proxying and QoS bandwidth allocation. Guess it wasn’t too hard for them…
- Also doesn’t provide NFS services out of the box.
Aside from it crashing a few times (which is looking more and more like it was my fault), the system has been pretty good. It has most of the features anyone would need as an SMB or advanced home server.
Routing and WAN performance with routing and such is excellent. Pings to local gaming servers seem to be slightly reduced by 20-30 milliseconds. The web proxying cache seems to have sped things up a little bit, though with most of the content I access being hosted locally in Australia the speed is already there, it’s more to do with saving bandwidth on not re-downloading the same content all the time.
I still can’t figure out what the deal with network fileserving is. The CPU load while transferring files at gigabit speeds are around 80-90%; I guess this is owing to the fact that I am using an mdadm Linux software RAID0? Samba to Windows Vista only yeilds about 30Mb/sec; though FTP is 80-120 Mb/sec (given this high number is impossible, I am doubting the accuracy of these numbers). iperf between systems is about 850Mbit though so I know the network isn’t the problem. It will require further troubleshooting methinks.
