Скорость сети на Linux NAS ниже, чем отлаживать (это не кабели)

перед публикацией я прочитал много тем / страниц / блогов о скорости сетей, не соответствующих спецификациям. Поэтому я купил новые кабели CAT6 UTP и провел тестирование между всеми устройствами в моей сети.

Теперь я получаю постоянную скорость около 110 Мбит / с между всеми устройствами, за исключением моего самосборного сетевого хранилища Linux. Он последовательно копирует файлы только на скорости 40 Мбит / с. Я проверил это с короткими кабелями, длинными кабелями, выделенным 1-гигабитным коммутатором (вместо того, чтобы мой гигабитный маршрутизатор выполнял маршрутизацию), всегда с тем же результатом. Я тестировал копирование по сети с SSD на SSD, SSD на HDD, без разницы (NAS имеет как SSD, так и HDD). Я пробовал SFTP, SMB, FTP, тоже без разницы. Во всех тестах нагрузка на NAS оставалась очень маленькой.

На данный момент моё подозрение - это аппаратное обеспечение и / или драйверы Linux, конфигурация. Как я могу отладить это?

[Обновить]

Максимальное использование 1 ядра при копировании файлов по сети. нагрузка показалась небольшой в 0,6 в мунине, но это в среднем за 5 минут. Таким образом, процессор является узким местом?

[обновление 2]

так что в моем случае драйвер немного помог, но в конце мое узкое место - это комбинация «протокол + процессор». только HTTP управляет максимальным соединением, тогда как sftp и smb ограничены процессором, возможно, некоторая настройка может уменьшить использование процессора для них обоих.

Спецификации:

OS: Debian 8 Board: ASRock N3150B-ITX Intel N3150 mITX CPU: Intel(R) Celeron(R) CPU N3150 @ 1.60GHz RAM: 8 GB HDD: 2 x WD Red WD40EFRX 4TB SSD: 1 x Kingston SSDNow V300 120GB MLC 

Подробные характеристики

lscpu

Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 76 Model name: Intel(R) Celeron(R) CPU N3150 @ 1.60GHz Stepping: 3 CPU MHz: 481.933 CPU max MHz: 2080,0000 CPU min MHz: 480,0000 BogoMIPS: 3202.01 Virtualization: VT-x L1d cache: 24K L1i cache: 32K L2 cache: 1024K NUMA node0 CPU(s): 0-3 

lshw

 description: Computer width: 64 bits capabilities: smbios-2.8 vsyscall32 *-core description: Motherboard physical id: 0 *-memory description: System memory physical id: 0 size: 7472MiB *-cpu product: Intel(R) Celeron(R) CPU N3150 @ 1.60GHz vendor: Intel Corp. physical id: 1 bus info: cpu@0 size: 479MHz capacity: 2080MHz width: 64 bits capabilities: fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp x86-64 constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 movbe popcnt tsc_deadline_timer aes rdrand lahf_lm 3dnowprefetch epb tpr_shadow vnmi flexpriority ept vpid tsc_adjust smep erms dtherm ida arat cpufreq *-pci description: Host bridge product: Intel Corporation vendor: Intel Corporation physical id: 100 bus info: pci@0000:00:00.0 version: 21 width: 32 bits clock: 33MHz configuration: driver=iosf_mbi_pci resources: irq:0 *-display description: VGA compatible controller product: Intel Corporation vendor: Intel Corporation physical id: 2 bus info: pci@0000:00:02.0 version: 21 width: 64 bits clock: 33MHz capabilities: pm msi vga_controller bus_master cap_list rom configuration: driver=i915 latency=0 resources: irq:121 memory:90000000-90ffffff memory:80000000-8fffffff ioport:f000(size=64) memory:c0000-dffff *-storage description: SATA controller product: Intel Corporation vendor: Intel Corporation physical id: 13 bus info: pci@0000:00:13.0 version: 21 width: 32 bits clock: 66MHz capabilities: storage msi pm ahci_1.0 bus_master cap_list configuration: driver=ahci latency=0 resources: irq:118 ioport:f060(size=32) memory:91415000-914157ff *-usb description: USB controller product: Intel Corporation vendor: Intel Corporation physical id: 14 bus info: pci@0000:00:14.0 version: 21 width: 64 bits clock: 33MHz capabilities: pm msi xhci bus_master cap_list configuration: driver=xhci_hcd latency=0 resources: irq:117 memory:91400000-9140ffff *-usbhost:0 product: xHCI Host Controller vendor: Linux 4.8.0-0.bpo.2-amd64 xhci-hcd physical id: 0 bus info: usb@1 logical name: usb1 version: 4.08 capabilities: usb-2.00 configuration: driver=hub slots=7 speed=480Mbit/s *-usb description: USB hub product: USB2.0 Hub vendor: Genesys Logic, Inc. physical id: 5 bus info: usb@1:5 version: 88.31 capabilities: usb-2.00 configuration: driver=hub maxpower=100mA slots=4 speed=480Mbit/s *-usbhost:1 product: xHCI Host Controller vendor: Linux 4.8.0-0.bpo.2-amd64 xhci-hcd physical id: 1 bus info: usb@2 logical name: usb2 version: 4.08 capabilities: usb-3.00 configuration: driver=hub slots=6 speed=5000Mbit/s *-generic UNCLAIMED description: Encryption controller product: Intel Corporation vendor: Intel Corporation physical id: 1a bus info: pci@0000:00:1a.0 version: 21 width: 32 bits clock: 33MHz capabilities: pm msi bus_master cap_list configuration: latency=0 resources: memory:91100000-911fffff memory:91000000-910fffff *-multimedia description: Audio device product: Intel Corporation vendor: Intel Corporation physical id: 1b bus info: pci@0000:00:1b.0 version: 21 width: 64 bits clock: 33MHz capabilities: pm msi bus_master cap_list configuration: driver=snd_hda_intel latency=0 resources: irq:122 memory:91410000-91413fff *-pci:0 description: PCI bridge product: Intel Corporation vendor: Intel Corporation physical id: 1c bus info: pci@0000:00:1c.0 version: 21 width: 32 bits clock: 33MHz capabilities: pci pciexpress msi pm normal_decode bus_master cap_list configuration: driver=pcieport resources: irq:115 ioport:e000(size=4096) memory:91300000-913fffff *-storage description: SATA controller product: 88SE9128 PCIe SATA 6 Gb/s RAID controller vendor: Marvell Technology Group Ltd. physical id: 0 bus info: pci@0000:01:00.0 version: 20 width: 32 bits clock: 33MHz capabilities: storage pm msi pciexpress ahci_1.0 bus_master cap_list rom configuration: driver=ahci latency=0 resources: irq:120 ioport:e050(size=8) ioport:e040(size=4) ioport:e030(size=8) ioport:e020(size=4) ioport:e000(size=32) memory:91310000-913107ff memory:91300000-9130ffff *-pci:1 description: PCI bridge product: Intel Corporation vendor: Intel Corporation physical id: 1c.1 bus info: pci@0000:00:1c.1 version: 21 width: 32 bits clock: 33MHz capabilities: pci pciexpress msi pm normal_decode bus_master cap_list configuration: driver=pcieport resources: irq:116 ioport:d000(size=4096) memory:91200000-912fffff *-network description: Ethernet interface product: RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller vendor: Realtek Semiconductor Co., Ltd. physical id: 0 bus info: pci@0000:02:00.0 logical name: eth0 version: 11 serial: d0:50:99:78:03:d2 size: 1Gbit/s capacity: 1Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical tp mii 10bt 10bt-fd 100bt 100bt-fd 1000bt 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=r8169 driverversion=2.3LK-NAPI duplex=full firmware=rtl8168g-2_0.0.1 02/06/13 ip=192.168.0.100 latency=0 link=yes multicast=yes port=MII speed=1Gbit/s resources: irq:119 ioport:d000(size=256) memory:91204000-91204fff memory:91200000-91203fff *-isa description: ISA bridge product: Intel Corporation vendor: Intel Corporation physical id: 1f bus info: pci@0000:00:1f.0 version: 21 width: 32 bits clock: 33MHz capabilities: isa bus_master cap_list configuration: driver=lpc_ich latency=0 resources: irq:0 *-serial description: SMBus product: Intel Corporation vendor: Intel Corporation physical id: 1f.3 bus info: pci@0000:00:1f.3 version: 21 width: 32 bits clock: 33MHz capabilities: pm cap_list configuration: driver=i801_smbus latency=0 resources: irq:18 memory:91414000-9141401f ioport:f040(size=32) *-scsi:0 physical id: 2 logical name: scsi0 capabilities: emulated *-disk description: ATA Disk product: KINGSTON SV300S3 physical id: 0.0.0 bus info: scsi@0:0.0.0 logical name: /dev/sda version: BBF0 serial: 50026B7854011055 size: 111GiB (120GB) capabilities: gpt-1.00 partitioned partitioned:gpt configuration: ansiversion=5 guid=bd0d92d8-3872-4af8-bd37-6e144769d696 logicalsectorsize=512 sectorsize=512 *-volume:0 description: Windows FAT volume vendor: mkfs.fat physical id: 1 bus info: scsi@0:0.0.0,1 logical name: /dev/sda1 logical name: /boot/efi version: FAT32 serial: a00b-19c0 size: 510MiB capacity: 511MiB capabilities: boot fat initialized configuration: FATs=2 filesystem=fat mount.fstype=vfat mount.options=rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=mixed,utf8,errors=remount-ro state=mounted *-volume:1 description: EXT4 volume vendor: Linux physical id: 2 bus info: scsi@0:0.0.0,2 logical name: /dev/sda2 logical name: / version: 1.0 serial: 3c53dc3f-51e0-4967-810a-46642c6dba53 size: 103GiB capabilities: journaled extended_attributes large_files huge_files dir_nlink recover extents ext4 ext2 initialized configuration: created=2017-01-03 17:06:08 filesystem=ext4 lastmountpoint=/ modified=2017-02-08 22:31:35 mount.fstype=ext4 mount.options=rw,relatime,errors=remount-ro,data=ordered mounted=2017-02-08 22:31:36 state=mounted *-volume:2 description: Linux swap volume vendor: Linux physical id: 3 bus info: scsi@0:0.0.0,3 logical name: /dev/sda3 version: 1 serial: 3e37cb96-5f81-48d1-be5b-ca47292b232f size: 7665MiB capacity: 7666MiB capabilities: nofs swap initialized configuration: filesystem=swap pagesize=4095 *-scsi:1 physical id: 3 logical name: scsi2 capabilities: emulated *-disk description: ATA Disk product: WDC WD40EFRX-68N vendor: Western Digital physical id: 0.0.0 bus info: scsi@2:0.0.0 logical name: /dev/sdb version: 0A82 serial: WD-WCC7K7HFN3K7 size: 3726GiB (4TB) configuration: ansiversion=5 logicalsectorsize=512 sectorsize=4096 *-scsi:2 physical id: 4 logical name: scsi3 capabilities: emulated *-disk description: ATA Disk product: WDC WD40EFRX-68N vendor: Western Digital physical id: 0.0.0 bus info: scsi@3:0.0.0 logical name: /dev/sdc version: 0A82 serial: WD-WCC7K1XSZYZ6 size: 3726GiB (4TB) configuration: ansiversion=5 logicalsectorsize=512 sectorsize=4096 *-scsi:3 physical id: 5 logical name: scsi9 capabilities: emulated *-processor UNCLAIMED description: SCSI Processor physical id: 0.0.0 bus info: scsi@9:0.0.0 *-network:0 description: Ethernet interface physical id: 1 logical name: vethBC83V0 serial: fe:72:5a:77:15:f2 size: 10Gbit/s capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=veth driverversion=1.0 duplex=full link=yes multicast=yes port=twisted pair speed=10Gbit/s *-network:1 description: Ethernet interface physical id: 2 logical name: veth4IKF6U serial: fe:a4:7f:d9:88:e8 size: 10Gbit/s capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=veth driverversion=1.0 duplex=full link=yes multicast=yes port=twisted pair speed=10Gbit/s *-network:2 description: Ethernet interface physical id: 3 logical name: veth6FWFI5 serial: fe:26:a4:3e:ec:22 size: 10Gbit/s capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=veth driverversion=1.0 duplex=full link=yes multicast=yes port=twisted pair speed=10Gbit/s *-network:3 DISABLED description: Ethernet interface physical id: 4 logical name: lxc-nic serial: 52:54:00:c6:f0:23 size: 10Mbit/s capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=tun driverversion=1.6 duplex=full link=no multicast=yes port=twisted pair speed=10Mbit/s 

hwinfo --short

cpu:  Intel(R) Celeron(R) CPU N3150 @ 1.60GHz, 480 MHz Intel(R) Celeron(R) CPU N3150 @ 1.60GHz, 480 MHz Intel(R) Celeron(R) CPU N3150 @ 1.60GHz, 480 MHz Intel(R) Celeron(R) CPU N3150 @ 1.60GHz, 480 MHz graphics card: Intel VGA compatible controller sound: Intel Audio device storage: Intel SATA controller Marvell 88SE9128 PCIe SATA 6 Gb/s RAID controller network: eth0 Realtek RTL8111/8168 PCI Express Gigabit Ethernet controller network interface: veth6FWFI5 Ethernet network interface lxc Ethernet network interface eth0 Ethernet network interface vethBC83V0 Ethernet network interface lxc-nic Ethernet network interface lo Loopback network interface veth4IKF6U Ethernet network interface disk: /dev/sdb WDC WD40EFRX-68N /dev/sdc WDC WD40EFRX-68N /dev/sda KINGSTON SV300S3 partition: /dev/sda1 Partition /dev/sda2 Partition /dev/sda3 Partition usb controller: Intel USB Controller bios: BIOS bridge: Intel Host bridge Intel PCI bridge Intel PCI bridge Intel ISA bridge hub: Linux 4.8.0-0.bpo.2-amd64 xhci-hcd xHCI Host Controller Genesys Logic USB2.0 Hub Linux 4.8.0-0.bpo.2-amd64 xhci-hcd xHCI Host Controller memory: Main Memory unknown: FPU DMA controller PIC Keyboard controller /dev/lp0 Parallel controller PS/2 Controller Intel SMBus Intel Encryption controller /dev/ttyS0 16550A /dev/ttyS1 16550A /dev/sg3 Marvell 91xx Config 

Утилита lspci

00:00.0 Host bridge: Intel Corporation Device 2280 (rev 21) 00:02.0 VGA compatible controller: Intel Corporation Device 22b1 (rev 21) 00:13.0 SATA controller: Intel Corporation Device 22a3 (rev 21) 00:14.0 USB controller: Intel Corporation Device 22b5 (rev 21) 00:1a.0 Encryption controller: Intel Corporation Device 2298 (rev 21) 00:1b.0 Audio device: Intel Corporation Device 2284 (rev 21) 00:1c.0 PCI bridge: Intel Corporation Device 22c8 (rev 21) 00:1c.1 PCI bridge: Intel Corporation Device 22ca (rev 21) 00:1f.0 ISA bridge: Intel Corporation Device 229c (rev 21) 00:1f.3 SMBus: Intel Corporation Device 2292 (rev 21) 01:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9128 PCIe SATA 6 Gb/s RAID controller (rev 20) 02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 11) 

ip a

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host  valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether d0:50:99:78:03:d2 brd ff:ff:ff:ff:ff:ff inet 192.168.0.100/24 brd 192.168.0.255 scope global eth0 valid_lft forever preferred_lft forever 5: lxc: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 52:54:00:c6:f0:23 brd ff:ff:ff:ff:ff:ff inet 10.11.0.1/24 brd 10.11.0.255 scope global lxc valid_lft forever preferred_lft forever 6: lxc-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master lxc state DOWN group default qlen 1000 link/ether 52:54:00:c6:f0:23 brd ff:ff:ff:ff:ff:ff 12: veth6FWFI5@if11: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master lxc state UP group default qlen 1000 link/ether fe:26:a4:3e:ec:22 brd ff:ff:ff:ff:ff:ff inet6 fe80::fc26:a4ff:fe3e:ec22/64 scope link  valid_lft forever preferred_lft forever 16: veth4IKF6U@if15: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master lxc state UP group default qlen 1000 link/ether fe:a4:7f:d9:88:e8 brd ff:ff:ff:ff:ff:ff inet6 fe80::fca4:7fff:fed9:88e8/64 scope link  valid_lft forever preferred_lft forever 38: vethBC83V0@if37: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master lxc state UP group default qlen 1000 link/ether fe:72:5a:77:15:f2 brd ff:ff:ff:ff:ff:ff inet6 fe80::fc72:5aff:fe77:15f2/64 scope link  valid_lft forever preferred_lft forever 

ethtool eth0

Settings for eth0: Supported ports: [ TP MII ] Supported link modes: 10baseT/Half 10baseT/Full  100baseT/Half 100baseT/Full  1000baseT/Half 1000baseT/Full  Supported pause frame use: No Supports auto-negotiation: Yes Advertised link modes: 10baseT/Half 10baseT/Full  100baseT/Half 100baseT/Full  1000baseT/Full  Advertised pause frame use: Symmetric Receive-only Advertised auto-negotiation: Yes Link partner advertised link modes: 10baseT/Half 10baseT/Full  100baseT/Half 100baseT/Full  1000baseT/Full  Link partner advertised pause frame use: Symmetric Link partner advertised auto-negotiation: Yes Speed: 1000Mb/s Duplex: Full Port: MII PHYAD: 0 Transceiver: internal Auto-negotiation: on Supports Wake-on: pumbg Wake-on: g Current message level: 0x00000033 (51) drv probe ifdown ifup Link detected: yes 

Iptables

iptables -L -n -v --line-numbers Chain INPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination  1 1280K 89M fail2ban-ssh tcp -- * * 0.0.0.0/0 0.0.0.0/0 multiport dports 22 2 0 0 ACCEPT udp -- lxc * 0.0.0.0/0 0.0.0.0/0 udp dpt:53 3 0 0 ACCEPT tcp -- lxc * 0.0.0.0/0 0.0.0.0/0 tcp dpt:53 4 0 0 ACCEPT udp -- lxc * 0.0.0.0/0 0.0.0.0/0 udp dpt:67 5 0 0 ACCEPT tcp -- lxc * 0.0.0.0/0 0.0.0.0/0 tcp dpt:67 6 615K 107M ACCEPT all -- lo * 0.0.0.0/0 0.0.0.0/0  7 0 0 REJECT all -- !lo * 0.0.0.0/0 127.0.0.0/8 reject-with icmp-port-unreachable 8 7065K 1431M ACCEPT all -- * * 0.0.0.0/0 0.0.0.0/0 state RELATED,ESTABLISHED 9 40 2560 ACCEPT tcp -- * * 0.0.0.0/0 192.168.0.100 state NEW tcp dpt:22 10 27 1724 ACCEPT tcp -- * * 0.0.0.0/0 192.168.0.100 state NEW tcp dpt:80 11 15377 923K ACCEPT tcp -- * * 10.11.0.10 10.11.0.1 state NEW tcp dpt:4949 12 340K 65M ACCEPT udp -- * * 192.168.0.0/24 0.0.0.0/0 state NEW udp dpt:5353 13 0 0 ACCEPT tcp -- * * 0.0.0.0/0 192.168.0.100 state NEW tcp dpt:3689 14 0 0 ACCEPT tcp -- * * 0.0.0.0/0 192.168.0.100 state NEW tcp dpt:6600 15 5 412 ACCEPT icmp -- * * 0.0.0.0/0 0.0.0.0/0 icmptype 8 16 309K 77M LOG all -- * * 0.0.0.0/0 0.0.0.0/0 limit: avg 5/min burst 5 LOG flags 0 level 7 prefix "iptables denied: " 17 441K 97M DROP all -- * * 0.0.0.0/0 0.0.0.0/0   Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination  1 429 38624 ACCEPT tcp -- * * 0.0.0.0/0 10.11.0.20 state NEW tcp dpt:445 2 7 444 ACCEPT tcp -- * * 0.0.0.0/0 10.11.0.20 state NEW tcp dpt:139 3 0 0 ACCEPT udp -- * * 0.0.0.0/0 10.11.0.20 state NEW udp dpt:138 4 2 156 ACCEPT udp -- * * 0.0.0.0/0 10.11.0.20 state NEW udp dpt:137 5 243M 228G ACCEPT all -- * lxc 0.0.0.0/0 10.11.0.0/24 ctstate RELATED,ESTABLISHED 6 84M 341G ACCEPT all -- lxc * 10.11.0.0/24 0.0.0.0/0  7 0 0 ACCEPT all -- lxc lxc 0.0.0.0/0 0.0.0.0/0  8 0 0 REJECT all -- * lxc 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable 9 0 0 REJECT all -- lxc * 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable 10 0 0 DROP all -- * * 0.0.0.0/0 0.0.0.0/0   Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes) num pkts bytes target prot opt in out source destination  1 0 0 ACCEPT udp -- * lxc 0.0.0.0/0 0.0.0.0/0 udp dpt:68 2 12M 9842M ACCEPT all -- * * 0.0.0.0/0 0.0.0.0/0   Chain fail2ban-ssh (1 references) num pkts bytes target prot opt in out source destination  1 1280K 89M RETURN all -- * * 0.0.0.0/0 0.0.0.0/0