Test
Yet another stress test :)
I tried to use ffsb in stress configuration (See configuration file below)
Conclusion
- OOoops !
Apr 28 22:55:33 fastboot kernel: Unable to handle kernel NULL pointer
dereference at virtual address 0000000c
Apr 28 22:55:33 fastboot kernel: printing eip:
Apr 28 22:55:33 fastboot kernel: c01f2051
Apr 28 22:55:33 fastboot kernel: *pde = 3356e001
Apr 28 22:55:33 fastboot kernel: *pte = 00000000
Apr 28 22:55:33 fastboot kernel: Oops: 0000 [#5]
Apr 28 22:55:33 fastboot kernel: SMP
Apr 28 22:55:33 fastboot kernel: Modules linked in: parport_pc lp parport
ide_cd cdrom autofs4 tg3 e1000 microcode ipv6 evde
Apr 28 22:55:33 fastboot kernel: CPU: 2
Apr 28 22:55:33 fastboot kernel: EIP: 0060:[] Not tainted VLI
Apr 28 22:55:33 fastboot kernel: EFLAGS: 00010246 (2.6.12-rc3)
Apr 28 22:55:33 fastboot kernel: EIP is at nfsd_sync+0x21/0xc0
Apr 28 22:55:33 fastboot kernel: eax: 00000000 ebx: c0000000 ecx: 00000000
edx: f693c480
Apr 28 22:55:33 fastboot kernel: esi: f693c480 edi: f038e0bc ebp: 00000002
esp: f69fddf4
Apr 28 22:55:33 fastboot kernel: ds: 007b es: 007b ss: 0068
Apr 28 22:55:33 fastboot kernel: Process nfsd (pid: 4470, threadinfo=f69fc000
task=f68bb020)
Apr 28 22:55:33 fastboot kernel: Stack: 4b87ad6e c0128a50 f68bb020 00000000
c0000000 f69fc000 f038e0bc 00000002
Apr 28 22:55:34 fastboot kernel: c01f2ae9 f693c480 00000002 00000002
f69fde50 00000001 ebf320c0 00000000
Apr 28 22:55:34 fastboot kernel: 00000282 00000003 00000002 00001000
f693c480 00000000 f5c2b058 00001000
Apr 28 22:55:34 fastboot kernel: Call Trace:
Apr 28 22:55:34 fastboot kernel: [] process_timeout+0x0/0x10
Apr 28 22:55:34 fastboot kernel: [] nfsd_write+0x1d9/0x6a0
Apr 28 22:55:34 fastboot kernel: [] export_decode_fh+0x5a/0x7a
Apr 28 22:55:34 fastboot kernel: [] nfsd_acceptable+0x0/0x110
Apr 28 22:55:34 fastboot kernel: [] fh_verify+0x2ee/0x5b0
Apr 28 22:55:34 fastboot kernel: []
nfs4_preprocess_stateid_op+0x199/0x3b0
Apr 28 22:55:34 fastboot kernel: []
nfsd4_proc_compound+0x1078/0x10d0
Apr 28 22:55:34 fastboot kernel: []
nfsd4_decode_compound+0x3c1/0x530
Apr 28 22:55:34 fastboot kernel: [] nfsd_dispatch+0xd7/0x200
Apr 28 22:55:34 fastboot kernel: [] nfsd_dispatch+0x0/0x200
Apr 28 22:55:34 fastboot kernel: [] svc_process+0x4bf/0x640
Apr 28 22:55:34 fastboot kernel: [] nfsd+0x1cb/0x360
Apr 28 22:55:34 fastboot kernel: [] nfsd+0x0/0x360
Apr 28 22:55:34 fastboot kernel: [] kernel_thread_helper+0x5/0x100
Apr 28 22:55:34 fastboot kernel: Code: 1c f7 ff 8d b4 26 00 00 00 00 83 ec 20
89 74 24 14 8b 74 24 24 89 5c 24 10 89 7c 24 18 89 6c 24 1c 8b 46 08 f6 05 f8
4e 53 c0 20 <8b> 50 0c 89 54 24 0c 75 76 8b 54 24 0c f0 ff 4a 74 0f 88 1d 2e
Here is one of this oops I get. I get 7 oops in 1 night. All 7 are the same.
There was 8 userland nfsd running at launch time. After testing 7 are crashed
Patches
Patches are avaiable on the CITI pages.
Software configuration
- Server :
- Export options are :
/export *(rw,wdelay,insecure,no_root_squash,no_subtree_check,fsid=0)
- mount options, NFSv4 :
rsize=32768,wsize=32768,timeo=14,intr,noauto -osec=krb5
- Linux 2.6.12-rc3-CITI_NFS4_ALL-1
- FFSB Configuration file
________________________________________________________________
benchmark time = 300
ThreadGroup 0
================
num_threads = 10
read_random = off
read_size = 4096 (4KB)
read_blocksize = 4096 (4KB)
write_random = on
write_size = 4096 (4KB)
write_blocksize = 4096 (4KB)
wait time = 0
op weights
read = 3 (60.00%)
readall = 0 (0.00%)
write = 1 (20.00%)
create = 0 (0.00%)
append = 1 (20.00%)
delete = 0 (0.00%)
metaop = 0 (0.00%)
rewritefsync = 0 (0.00%)
FileSystem /mnt/benchs_nfs/test
==========
num_dirs= 100
starting files = 1200000
min file size = 4096 (4KB)
max file size = 4096 (4KB)
directio = off
alignedio = off
bufferedio = off
aging is off current utilization = 0.18
________________________________________________________________
hardware configuration
Client
- 2 processors : Intel(R)
- Xeon(TM) CPU 2.80GHz, cache 512 KB
- Total memory: 2Gb
- Ethernet: 1Gb/s link
- Distribution : modified Fedora Core 2
Server
- 4 processors : Intel(R) Xeon(TM) CPU 2.80GHz, cache 512 KB
- Total memory: 24Gb
- Ethernet: 1Gb/s link
- Distribution : modified Fedora Core 2