* [ltt-dev] Panic on SH with the Kernel 2.6.30.9
@ 2010-01-07 15:11 Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
` (2 more replies)
0 siblings, 3 replies; 5+ messages in thread
From: Giuseppe CAVALLARO @ 2010-01-07 15:11 UTC (permalink / raw)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi Mathieu,
using lttng-0.162 with an STLinux kernel 2.6.30.9, I get a panic (see
the log attached).
I work on an STM board with an SH4-300 CPU (128MiB RAM).
I mount a rooFS via NFS and run the following commands before having the
panic.
$ ltt-armall
$ lttctl -C -w /tmp/trace1 trace1 |-> ltt-control-0.75
$ ls -lR / |-> After a few seconds I get
|-> the panic.
This is my Kernel configuration for LTT:
CONFIG_LTT=y
CONFIG_LTT_FILTER=y
CONFIG_HAVE_LTT_DUMP_TABLES=y
CONFIG_LTT_RELAY_ALLOC=y
CONFIG_LTT_RELAY_LOCKLESS=y
# CONFIG_LTT_RELAY_IRQOFF is not set
# CONFIG_LTT_RELAY_LOCKED is not set
CONFIG_LTT_SERIALIZE=y
CONFIG_LTT_FAST_SERIALIZE=y
CONFIG_LTT_TRACEPROBES=y
CONFIG_LTT_TRACE_CONTROL=y
CONFIG_LTT_TRACER=y
CONFIG_LTT_ALIGNMENT=y
CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_LTT_DEBUG_EVENT_SIZE=y
CONFIG_LTT_USERSPACE_EVENT=y
CONFIG_LTT_VMCORE=y
CONFIG_LTT_STATEDUMP=y
CONFIG_LTT_ASCII=y
Problem happens when I turn-on LTT_TRACEPROBES at config time.
Welcome advice.
Regards,
Peppe
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAktF+bcACgkQ2Xo3j31MSSIAAgCghLuvB1Ffbbqp4fCWc0IF9KtR
BL0An3tOxwkKjCCPDA7j4wzNSb7nlmS3
=s1sE
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ltt.log
Type: text/x-log
Size: 18967 bytes
Desc: not available
URL: <http://lists.casi.polymtl.ca/pipermail/ltt-dev/attachments/20100107/6405a2ae/attachment.bin>
^ permalink raw reply [flat|nested] 5+ messages in thread* [ltt-dev] Panic on SH with the Kernel 2.6.30.9
2010-01-07 15:11 [ltt-dev] Panic on SH with the Kernel 2.6.30.9 Giuseppe CAVALLARO
@ 2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:23 ` Mathieu Desnoyers
2 siblings, 0 replies; 5+ messages in thread
From: Giuseppe CAVALLARO @ 2010-01-07 15:11 UTC (permalink / raw)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi Mathieu,
using lttng-0.162 with an STLinux kernel 2.6.30.9, I get a panic (see
the log attached).
I work on an STM board with an SH4-300 CPU (128MiB RAM).
I mount a rooFS via NFS and run the following commands before having the
panic.
$ ltt-armall
$ lttctl -C -w /tmp/trace1 trace1 |-> ltt-control-0.75
$ ls -lR / |-> After a few seconds I get
|-> the panic.
This is my Kernel configuration for LTT:
CONFIG_LTT=y
CONFIG_LTT_FILTER=y
CONFIG_HAVE_LTT_DUMP_TABLES=y
CONFIG_LTT_RELAY_ALLOC=y
CONFIG_LTT_RELAY_LOCKLESS=y
# CONFIG_LTT_RELAY_IRQOFF is not set
# CONFIG_LTT_RELAY_LOCKED is not set
CONFIG_LTT_SERIALIZE=y
CONFIG_LTT_FAST_SERIALIZE=y
CONFIG_LTT_TRACEPROBES=y
CONFIG_LTT_TRACE_CONTROL=y
CONFIG_LTT_TRACER=y
CONFIG_LTT_ALIGNMENT=y
CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_LTT_DEBUG_EVENT_SIZE=y
CONFIG_LTT_USERSPACE_EVENT=y
CONFIG_LTT_VMCORE=y
CONFIG_LTT_STATEDUMP=y
CONFIG_LTT_ASCII=y
Problem happens when I turn-on LTT_TRACEPROBES at config time.
Welcome advice.
Regards,
Peppe
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAktF+bcACgkQ2Xo3j31MSSIAAgCghLuvB1Ffbbqp4fCWc0IF9KtR
BL0An3tOxwkKjCCPDA7j4wzNSb7nlmS3
=s1sE
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ltt.log
Type: text/x-log
Size: 18967 bytes
Desc: not available
URL: <http://lists.casi.polymtl.ca/pipermail/lttng-dev/attachments/20100107/6405a2ae/attachment-0003.bin>
^ permalink raw reply [flat|nested] 5+ messages in thread* [ltt-dev] Panic on SH with the Kernel 2.6.30.9
2010-01-07 15:11 [ltt-dev] Panic on SH with the Kernel 2.6.30.9 Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
@ 2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:23 ` Mathieu Desnoyers
2 siblings, 0 replies; 5+ messages in thread
From: Giuseppe CAVALLARO @ 2010-01-07 15:11 UTC (permalink / raw)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi Mathieu,
using lttng-0.162 with an STLinux kernel 2.6.30.9, I get a panic (see
the log attached).
I work on an STM board with an SH4-300 CPU (128MiB RAM).
I mount a rooFS via NFS and run the following commands before having the
panic.
$ ltt-armall
$ lttctl -C -w /tmp/trace1 trace1 |-> ltt-control-0.75
$ ls -lR / |-> After a few seconds I get
|-> the panic.
This is my Kernel configuration for LTT:
CONFIG_LTT=y
CONFIG_LTT_FILTER=y
CONFIG_HAVE_LTT_DUMP_TABLES=y
CONFIG_LTT_RELAY_ALLOC=y
CONFIG_LTT_RELAY_LOCKLESS=y
# CONFIG_LTT_RELAY_IRQOFF is not set
# CONFIG_LTT_RELAY_LOCKED is not set
CONFIG_LTT_SERIALIZE=y
CONFIG_LTT_FAST_SERIALIZE=y
CONFIG_LTT_TRACEPROBES=y
CONFIG_LTT_TRACE_CONTROL=y
CONFIG_LTT_TRACER=y
CONFIG_LTT_ALIGNMENT=y
CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_LTT_DEBUG_EVENT_SIZE=y
CONFIG_LTT_USERSPACE_EVENT=y
CONFIG_LTT_VMCORE=y
CONFIG_LTT_STATEDUMP=y
CONFIG_LTT_ASCII=y
Problem happens when I turn-on LTT_TRACEPROBES at config time.
Welcome advice.
Regards,
Peppe
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAktF+bcACgkQ2Xo3j31MSSIAAgCghLuvB1Ffbbqp4fCWc0IF9KtR
BL0An3tOxwkKjCCPDA7j4wzNSb7nlmS3
=s1sE
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ltt.log
Type: text/x-log
Size: 18967 bytes
Desc: not available
URL: <http://lists.casi.polymtl.ca/pipermail/lttng-dev/attachments/20100107/6405a2ae/attachment-0002.bin>
^ permalink raw reply [flat|nested] 5+ messages in thread* [ltt-dev] Panic on SH with the Kernel 2.6.30.9
2010-01-07 15:11 [ltt-dev] Panic on SH with the Kernel 2.6.30.9 Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
@ 2010-01-07 15:23 ` Mathieu Desnoyers
2010-01-07 15:34 ` Giuseppe CAVALLARO
2 siblings, 1 reply; 5+ messages in thread
From: Mathieu Desnoyers @ 2010-01-07 15:23 UTC (permalink / raw)
You should probably try lttng 0.170 for kernel 2.6.31.6 instead. This
version fixed a lot of bugs discovered by heavy stress-testing.
I think your problem comes from the new network synchronization markers
added around there versions. They had incorrect type sizes for the event
payload and therefore caused problems. They were fixed a few versions
later. Just disabling the network "extra" instrumentation should also
work.
Thanks,
Mathieu
* Giuseppe CAVALLARO (peppe.cavallaro at st.com) wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi Mathieu,
> using lttng-0.162 with an STLinux kernel 2.6.30.9, I get a panic (see
> the log attached).
> I work on an STM board with an SH4-300 CPU (128MiB RAM).
> I mount a rooFS via NFS and run the following commands before having the
> panic.
>
> $ ltt-armall
> $ lttctl -C -w /tmp/trace1 trace1 |-> ltt-control-0.75
> $ ls -lR / |-> After a few seconds I get
> |-> the panic.
>
> This is my Kernel configuration for LTT:
> CONFIG_LTT=y
> CONFIG_LTT_FILTER=y
> CONFIG_HAVE_LTT_DUMP_TABLES=y
> CONFIG_LTT_RELAY_ALLOC=y
> CONFIG_LTT_RELAY_LOCKLESS=y
> # CONFIG_LTT_RELAY_IRQOFF is not set
> # CONFIG_LTT_RELAY_LOCKED is not set
> CONFIG_LTT_SERIALIZE=y
> CONFIG_LTT_FAST_SERIALIZE=y
> CONFIG_LTT_TRACEPROBES=y
> CONFIG_LTT_TRACE_CONTROL=y
> CONFIG_LTT_TRACER=y
> CONFIG_LTT_ALIGNMENT=y
> CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y
> CONFIG_LTT_DEBUG_EVENT_SIZE=y
> CONFIG_LTT_USERSPACE_EVENT=y
> CONFIG_LTT_VMCORE=y
> CONFIG_LTT_STATEDUMP=y
> CONFIG_LTT_ASCII=y
>
> Problem happens when I turn-on LTT_TRACEPROBES at config time.
>
> Welcome advice.
>
> Regards,
> Peppe
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAktF+bcACgkQ2Xo3j31MSSIAAgCghLuvB1Ffbbqp4fCWc0IF9KtR
> BL0An3tOxwkKjCCPDA7j4wzNSb7nlmS3
> =s1sE
> -----END PGP SIGNATURE-----
> ------------[ cut here ]------------
> Badness at 8011a250 [verbose debug info unavailable]
>
> Pid : 0, Comm: swapper
> CPU : 0 Not tainted (2.6.30.9_stm24_0200-mb628 #8)
>
> PC is at ltt_relay_offset_address+0x30/0x58
> PR is at ltt_reserve_switch_new_subbuf+0x40/0x184
> PC : 8011a250 SP : 8027fdc4 SR : 40008101 TEA : 295f4280
> R0 : 00000001 R1 : 00000000 R2 : 8027fe04 R3 : 00040000
> R4 : 87bbdcc0 R5 : 00040000 R6 : 864ae801 R7 : 00040000
> R8 : 6d25e3d3 R9 : 00000000 R10 : 864ae000 R11 : 8795b2c0
> R12 : 87bc0840 R13 : 00000001 R14 : 87bbdcc0
> MACH: 00004437 MACL: 00040000 GBR : 29698470 PR : 8011956c
>
> Call trace:
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011f84c>] probe_net_napi_schedule+0x1c/0x2c
> [<80192210>] __napi_schedule+0x24/0xa8
> [<8016624e>] stmmac_interrupt+0x1c6/0x228
> [<800379d6>] handle_IRQ_event+0xb2/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<8000ac18>] ilc_irq_demux+0xbc/0x1ac
> [<8001a796>] do_softirq+0x36/0x68
> [<800034cc>] do_IRQ+0x28/0x4c
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<80007746>] ret_from_irq+0x0/0x1a
> [<8000f788>] add_preempt_count+0x0/0x78
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80003020>] default_idle+0x0/0x80
> [<80060488>] quicklist_trim+0x0/0x128
> [<8000f788>] add_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<80003082>] default_idle+0x62/0x80
> [<800030dc>] cpu_idle+0x3c/0x88
> [<801eaff8>] printk+0x0/0x80
> [<80129ab0>] debug_smp_processor_id+0x0/0xa4
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120ab6>] __const_udelay+0x0/0x22
>
> Unaligned kernel access on behalf of "swapper" pid=0 pc=0x8011a26a ins=0x8001
> Unable to handle kernel paging request at virtual address e0864ef0
> pc = 8011956e
> *pde = 00000000
> Oops: 0001 [#1]
> Modules linked in:
>
> Pid : 0, Comm: swapper
> CPU : 0 Tainted: GW (2.6.30.9_stm24_0200-mb628 #8)
>
> PC is at ltt_reserve_switch_new_subbuf+0x42/0x184
> PR is at ltt_reserve_switch_new_subbuf+0x40/0x184
> PC : 8011956e SP : 8027fdc4 SR : 40008101 TEA : e0864ef0
> R0 : e0864ef0 R1 : ffffffff R2 : 00000001 R3 : 00000000
> R4 : 87bbdcc0 R5 : 00040000 R6 : 864ae801 R7 : 00000000
> R8 : 6d25e3d3 R9 : 00000000 R10 : 864ae000 R11 : 8795b2c0
> R12 : 87bc0840 R13 : 00000001 R14 : 87bbdcc0
> MACH: 00004437 MACL: 00040000 GBR : 29698470 PR : 8011956c
>
> Call trace:
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011f84c>] probe_net_napi_schedule+0x1c/0x2c
> [<80192210>] __napi_schedule+0x24/0xa8
> [<8016624e>] stmmac_interrupt+0x1c6/0x228
> [<800379d6>] handle_IRQ_event+0xb2/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<8000ac18>] ilc_irq_demux+0xbc/0x1ac
> [<8001a796>] do_softirq+0x36/0x68
> [<800034cc>] do_IRQ+0x28/0x4c
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<80007746>] ret_from_irq+0x0/0x1a
> [<8000f788>] add_preempt_count+0x0/0x78
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80003020>] default_idle+0x0/0x80
> [<80060488>] quicklist_trim+0x0/0x128
> [<8000f788>] add_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<80003082>] default_idle+0x62/0x80
> [<800030dc>] cpu_idle+0x3c/0x88
> [<801eaff8>] printk+0x0/0x80
> [<80129ab0>] debug_smp_processor_id+0x0/0xa4
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120ab6>] __const_udelay+0x0/0x22
>
> Process: swapper (pid: 0, stack limit = 8027e001)
> Stack: (0x8027fdc4 to 0x80280000)
> fdc0: 8795b2c0 80119ca4 87bc0840 0000fffe 00000004 87bbdcc0 8027fe04
> fde0: 864ae000 8027fe8c 8027fe04 8027fe8c 00000004 8795b2c0 864ae000 0003ffec
> fe00: 87bbdcc0 00040044 00040050 0003fff8 00000001 00000000 00000001 00000000
> fe20: 0000000c 8011ce8e 8795b2c0 00000004 8027fe68 87bbdcc0 864ae000 87bc0840
> fe40: 0003fff8 8027fea4 8027fe9c 8027fe8c 8027fe98 00000004 00000000 8027fe94
> fe60: 7fd80170 7fd8016c 7fd80138 7fd80134 8027fecc 00000004 000002c0 0000000b
> fe80: 87a97200 00000000 20000000 6d25e3d3 00000000 00000008 00000002 00000000
> fea0: 87bbdcc0 0000000c 8011f84c 802a7d84 00000000 00000070 fd119014 87889e40
> fec0: 87831c20 87bb2e0c 00000004 87831c20 80192210 8016624e 87831b00 00370401
> fee0: 800379d6 00000000 87889e40 80288e18 87ad3eec 800395f0 802836a2 00000040
> ff00: 8028369c 00000100 00000070 80288e18 87889e40 8000ac18 0000001f 00000001
> ff20: 87815a80 0000002f 8001a796 87aaa600 8028369e 800034cc 87aaa600 802c22c0
> ff40: 8000f710 801eb64c 00000000 8029385c 00000040 80007746 8000f788 800034a4
> ff60: 400081f1 00000000 8027e000 8027e000 00000003 00000001 00000001 00000019
> ff80: 00000010 80003020 80060488 8000f788 801eb64c 8000f710 802c22c0 87aaa600
> ffa0: 8027ffc0 80003082 800030dc 40008101 29698470 00004437 00000000 ffffffff
> ffc0: 802a9934 801eaff8 802bd29b 802bccf4 80280840 80129ab0 80282dce 802a9284
> ffe0: 802bd198 00000000 87bd8a00 80037228 802c3658 80120ab6 0004bf6c 00000000
> Kernel panic - not syncing: Fatal exception in interrupt
> ------------[ cut here ]------------
> Badness at 80117b80 [verbose debug info unavailable]
>
> Pid : 0, Comm: swapper
> CPU : 0 Tainted: G D W (2.6.30.9_stm24_0200-mb628 #8)
>
> PC is at ltt_write_event_header_slow+0x88/0x968
> PR is at ltt_vtrace+0x480/0x664
> PC : 80117b80 SP : 8027f758 SR : 400081f1 TEA : 8795b801
> R0 : 00000001 R1 : 00000000 R2 : 869ed200 R3 : 00100000
> R4 : 8795b801 R5 : 00100060 R6 : f619db54 R7 : 00000004
> R8 : 00000004 R9 : 87bbdc80 R10 : 00000002 R11 : 00100060
> R12 : 87bbdc80 R13 : 8795b200 R14 : 87a97200
> MACH: 00004ed0 MACL: 0000000c GBR : 29698470 PR : 8011b164
>
> Call trace:
> [<80030011>] clockevent_delta2ns+0x55/0xa4
> [<8011b164>] ltt_vtrace+0x480/0x664
> [<8003cb88>] marker_probe_cb+0x40/0x9c
> [<80121742>] report_bug+0x26/0x80
> [<801eb032>] printk+0x3a/0x80
> [<80121742>] report_bug+0x26/0x80
> [<80121742>] report_bug+0x26/0x80
> [<80121742>] report_bug+0x26/0x80
> [<801eaff8>] printk+0x0/0x80
> [<80117b80>] ltt_write_event_header_slow+0x88/0x968
> [<80117b82>] ltt_write_event_header_slow+0x8a/0x968
> [<80005e72>] bug_trap_handler+0x4a/0x98
> [<80007740>] ret_from_exception+0x0/0x6
> [<80005e28>] bug_trap_handler+0x0/0x98
> [<80117b80>] ltt_write_event_header_slow+0x88/0x968
> [<8011cfc4>] _ltt_specialized_trace+0x3dc/0x694
> [<8011b730>] ltt_serialize_data+0x0/0xd40
> [<8003002a>] clockevent_delta2ns+0x6e/0xa4
> [<8011cfc4>] _ltt_specialized_trace+0x3dc/0x694
> [<8011f41e>] probe_trap_entry+0x2e/0x40
> [<8011a26a>] ltt_relay_offset_address+0x4a/0x58
> [<80006cba>] do_address_error+0x3a/0x380
> [<8011b1a4>] ltt_vtrace+0x4c0/0x664
> [<8011b2e4>] ltt_vtrace+0x600/0x664
> [<80007740>] ret_from_exception+0x0/0x6
> [<80007700>] address_error_load+0x0/0x4
> [<8011a26a>] ltt_relay_offset_address+0x4a/0x58
> [<8011956c>] ltt_reserve_switch_new_subbuf+0x40/0x184
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011ecee>] probe_irq_exit+0x1e/0x30
> [<80037ac2>] handle_IRQ_event+0x19e/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<800034cc>] do_IRQ+0x28/0x4c
> [<80007746>] ret_from_irq+0x0/0x1a
> [<80120ab6>] __const_udelay+0x0/0x22
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80120ab6>] __const_udelay+0x0/0x22
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120aca>] __const_udelay+0x14/0x22
> [<801eafa6>] panic+0x10e/0x160
> [<800064b2>] die+0xf6/0x16c
> [<801eaff8>] printk+0x0/0x80
> [<8000d0c8>] do_page_fault+0x348/0x448
> [<801eaff8>] printk+0x0/0x80
> [<8011ecee>] probe_irq_exit+0x1e/0x30
> [<80037ae0>] handle_IRQ_event+0x1bc/0x200
> [<80039602>] handle_level_irq+0x96/0x104
> [<80039622>] handle_level_irq+0xb6/0x104
> [<80039628>] handle_level_irq+0xbc/0x104
> [<800034cc>] do_IRQ+0x28/0x4c
> [<80007740>] ret_from_exception+0x0/0x6
> [<800076c4>] tlb_miss_store+0x0/0x4
> [<8011956e>] ltt_reserve_switch_new_subbuf+0x42/0x184
> [<8011956c>] ltt_reserve_switch_new_subbuf+0x40/0x184
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011f84c>] probe_net_napi_schedule+0x1c/0x2c
> [<80192210>] __napi_schedule+0x24/0xa8
> [<8016624e>] stmmac_interrupt+0x1c6/0x228
> [<800379d6>] handle_IRQ_event+0xb2/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<8000ac18>] ilc_irq_demux+0xbc/0x1ac
> [<8001a796>] do_softirq+0x36/0x68
> [<800034cc>] do_IRQ+0x28/0x4c
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<80007746>] ret_from_irq+0x0/0x1a
> [<8000f788>] add_preempt_count+0x0/0x78
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80003020>] default_idle+0x0/0x80
> [<80060488>] quicklist_trim+0x0/0x128
> [<8000f788>] add_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<80003082>] default_idle+0x62/0x80
> [<800030dc>] cpu_idle+0x3c/0x88
> [<801eaff8>] printk+0x0/0x80
> [<80129ab0>] debug_smp_processor_id+0x0/0xa4
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120ab6>] __const_udelay+0x0/0x22
>
> Unaligned kernel access on behalf of "swapper" pid=0 pc=0x80117b98 ins=0x8027
> Unable to handle kernel paging request at virtual address c086b140
> pc = 80117bf2
> *pde = 00000000
> Oops: 0001 [#2]
> Modules linked in:
>
> Pid : 0, Comm: swapper
> CPU : 0 Tainted: G D W (2.6.30.9_stm24_0200-mb628 #8)
>
> PC is at ltt_write_event_header_slow+0xfa/0x968
> PR is at ltt_vtrace+0x480/0x664
> PC : 80117bf2 SP : 8027f758 SR : 400081f1 TEA : c086b140
> R0 : 00000000 R1 : 0000003a R2 : 00000004 R3 : c086b140
> R4 : 8795b801 R5 : 00100060 R6 : f619db54 R7 : 00000004
> R8 : 00000004 R9 : 87bbdc80 R10 : 00000002 R11 : 00100060
> R12 : 87bbdc80 R13 : 8795b200 R14 : 87a97200
> MACH: 00004ed0 MACL: 0000000c GBR : 29698470 PR : 8011b164
>
> Call trace:
> [<80030011>] clockevent_delta2ns+0x55/0xa4
> [<8011b164>] ltt_vtrace+0x480/0x664
> [<8003cb88>] marker_probe_cb+0x40/0x9c
> [<80121742>] report_bug+0x26/0x80
> [<801eb032>] printk+0x3a/0x80
> [<80121742>] report_bug+0x26/0x80
> [<80121742>] report_bug+0x26/0x80
> [<80121742>] report_bug+0x26/0x80
> [<801eaff8>] printk+0x0/0x80
> [<80117b80>] ltt_write_event_header_slow+0x88/0x968
> [<80117b82>] ltt_write_event_header_slow+0x8a/0x968
> [<80005e72>] bug_trap_handler+0x4a/0x98
> [<80007740>] ret_from_exception+0x0/0x6
> [<80005e28>] bug_trap_handler+0x0/0x98
> [<80117b80>] ltt_write_event_header_slow+0x88/0x968
> [<8011cfc4>] _ltt_specialized_trace+0x3dc/0x694
> [<8011b730>] ltt_serialize_data+0x0/0xd40
> [<8003002a>] clockevent_delta2ns+0x6e/0xa4
> [<8011cfc4>] _ltt_specialized_trace+0x3dc/0x694
> [<8011f41e>] probe_trap_entry+0x2e/0x40
> [<8011a26a>] ltt_relay_offset_address+0x4a/0x58
> [<80006cba>] do_address_error+0x3a/0x380
> [<8011b1a4>] ltt_vtrace+0x4c0/0x664
> [<8011b2e4>] ltt_vtrace+0x600/0x664
> [<80007740>] ret_from_exception+0x0/0x6
> [<80007700>] address_error_load+0x0/0x4
> [<8011a26a>] ltt_relay_offset_address+0x4a/0x58
> [<8011956c>] ltt_reserve_switch_new_subbuf+0x40/0x184
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011ecee>] probe_irq_exit+0x1e/0x30
> [<80037ac2>] handle_IRQ_event+0x19e/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<800034cc>] do_IRQ+0x28/0x4c
> [<80007746>] ret_from_irq+0x0/0x1a
> [<80120ab6>] __const_udelay+0x0/0x22
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80120ab6>] __const_udelay+0x0/0x22
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120aca>] __const_udelay+0x14/0x22
> [<801eafa6>] panic+0x10e/0x160
> [<800064b2>] die+0xf6/0x16c
> [<801eaff8>] printk+0x0/0x80
> [<8000d0c8>] do_page_fault+0x348/0x448
> [<801eaff8>] printk+0x0/0x80
> [<8011ecee>] probe_irq_exit+0x1e/0x30
> [<80037ae0>] handle_IRQ_event+0x1bc/0x200
> [<80039602>] handle_level_irq+0x96/0x104
> [<80039622>] handle_level_irq+0xb6/0x104
> [<80039628>] handle_level_irq+0xbc/0x104
> [<800034cc>] do_IRQ+0x28/0x4c
> [<80007740>] ret_from_exception+0x0/0x6
> [<800076c4>] tlb_miss_store+0x0/0x4
> [<8011956e>] ltt_reserve_switch_new_subbuf+0x42/0x184
> [<8011956c>] ltt_reserve_switch_new_subbuf+0x40/0x184
> [<80119ca4>] ltt_reserve_slot_lockless_slow+0x338/0x4cc
> [<8011ce8e>] _ltt_specialized_trace+0x2a6/0x694
> [<8011f84c>] probe_net_napi_schedule+0x1c/0x2c
> [<80192210>] __napi_schedule+0x24/0xa8
> [<8016624e>] stmmac_interrupt+0x1c6/0x228
> [<800379d6>] handle_IRQ_event+0xb2/0x200
> [<800395f0>] handle_level_irq+0x84/0x104
> [<8000ac18>] ilc_irq_demux+0xbc/0x1ac
> [<8001a796>] do_softirq+0x36/0x68
> [<800034cc>] do_IRQ+0x28/0x4c
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<80007746>] ret_from_irq+0x0/0x1a
> [<8000f788>] add_preempt_count+0x0/0x78
> [<800034a4>] do_IRQ+0x0/0x4c
> [<80003020>] default_idle+0x0/0x80
> [<80060488>] quicklist_trim+0x0/0x128
> [<8000f788>] add_preempt_count+0x0/0x78
> [<801eb64c>] schedule+0x0/0x44
> [<8000f710>] sub_preempt_count+0x0/0x78
> [<80003082>] default_idle+0x62/0x80
> [<800030dc>] cpu_idle+0x3c/0x88
> [<801eaff8>] printk+0x0/0x80
> [<80129ab0>] debug_smp_processor_id+0x0/0xa4
> [<80037228>] touch_softlockup_watchdog+0x0/0xc
> [<80120ab6>] __const_udelay+0x0/0x22
>
> Process: swapper (pid: 0, stack limit = 8027e001)
> Stack: (0x8027f758 to 0x80280000)
> f740: 00000000 80030011
> f760: f619db54 8027f7dc 8011b164 869ed200 8027f7dc 87bbdc80 00100060 00000011
> f780: 00000004 7e19db54 00000000 00000002 00000000 8027f800 7fd80804 7fd80800
> f7a0: 80258602 00000200 00000004 00000011 00000004 00000008 00000000 00000000
> f7c0: 00000000 88000000 80293540 00000000 00000000 00000000 00000000 00000000
> f7e0: 00000000 00000000 00000000 00000000 00000000 00000000 7e19db54 00000000
> f800: 00000000 00000002 8027f85c 00100060 87bbdc80 0000000e 00000004 8003cb88
> f820: 8795b200 00000006 00000058 8027f8ac 00000000 80121742 802a6008 8027f840
> f840: 8027f85c 801eb032 00000058 8027f8ac 80244ac8 80121742 87bb20ec 80121742
> f860: ffffffff 8027f878 80121742 801eaff8 80117b80 8025cad8 80117b82 00000000
> f880: ffffffff 80005e72 ffffff0f 0000003c 8027f8ac 8027f8ec 0000003e 00000005
> f8a0: 80007740 00000038 80005e28 00000001 00000000 869ed200 00100000 8795b801
> f8c0: 00100050 f619d451 00000004 00000004 87bbdc80 00000002 00100050 8027f950
> f8e0: 00000006 8795b200 8027f908 80117b80 8011cfc4 400081f1 29698470 00004ed0
> f900: 0000000c ffffffff 8011b730 8003002a f619d451 869ed200 8011cfc4 87bbdc80
> f920: 869ed200 00100050 87bbdc80 0000002a 00000006 7e19d451 00000000 00000002
> f940: 00000018 8027f97c 7fd80688 7fd80684 7fd80650 7fd8064c 8027f9b4 0000002a
> f960: 00000200 00000008 87a97200 00000000 50000000 7e19d451 00000000 00000060
> f980: 00000002 00100050 87bbdc80 00000011 8011f41e 87bbdc80 00000001 8795b801
> f9a0: 000000e0 00000007 8027fa60 87bb27ec 00000004 8011a26a 7fd80007 80006cba
> f9c0: 7fd80614 7fd80620 7fd8061c ffff2276 00000000 00000000 00000020 00000000
> f9e0: 0000000f 00000010 8011b1a4 0000000e 8795b200 8011b2e4 8027fb1c 000faffc
> fa00: 00000008 87bbdc80 ffff2c18 8025864f 000faffc 00000004 8027fa60 8027fa5c
> fa20: 8027fa54 7fd805a4 7fd805a0 7fd805a8 7fd805a4 7fd805b0 7fd805ac 00000000
> fa40: 00000000 87bbdc80 80007740 87bc0720 8795b200 869ed200 80007700 0000001c
> fa60: 00000000 00000fff 8027fafc 00000000 87bbdc80 00100000 8795b801 00000000
> fa80: 7e19d35a 00000000 869ed200 8795b200 87bc0720 00000001 87bbdc80 8027fabc
> faa0: 8011a26a 8011956c 400081f0 29698470 00004ed0 00100000 ffffffff 8795b200
> fac0: 80119ca4 87bc0720 0000fffe 00000001 87bbdc80 8027fafc 869ed200 8027fb84
> fae0: 8027fafc 8027fb84 00000001 8795b200 0000001e 00000001 7e19d2ce 00100044
> fb00: 0010004d 000ffff9 00000001 00000000 00000001 00000000 00000009 8011ce8e
> fb20: 8795b200 00000001 8027fb60 87bbdc80 869ed200 87bc0720 000ffff9 8027fb9c
> fb40: 8027fb94 8027fb84 8027fb90 00000001 00000000 8027fb8c 7fd80478 7fd80474
> fb60: 7fd8043d 7fd80439 8027fbc7 00000002 00000200 00000008 87a97200 00000000
> fb80: 10000000 7e19d35a 00000000 00000000 00000002 00000000 87bbdc80 0000000c
> fba0: 8011ecee 802a7d84 00000001 00000010 00000000 00000000 00000001 87ad3f4c
> fbc0: 00000001 01ad3eec 80037ac2 800395f0 87bbdcc0 00000001 80037228 00000100
> fbe0: 00000010 80287018 80284154 800034cc 802c3658 8027ff64 8029385c 00000010
> fc00: 80007746 80120ab6 800034a4 400081f1 00000000 0235c000 00092000 00003fff
> fc20: 000092c6 00000000 802c3680 ffffffff 00000000 00004067 80120ab6 802c3658
> fc40: 80037228 00000001 87bbdcc0 8027fc6c 80120aca 801eafa6 40008100 29698470
> fc60: 00024332 91100000 ffffffff 8027fc90 800064b2 87bbdcc0 00000001 8027fd68
> fc80: 00000001 8022c140 8027fd68 801eaff8 00000001 8027fc84 00000280 000000ff
> fca0: 0000000b 8000d0c8 00030001 000e0864 801eaff8 00000000 7fd802e5 7fd802e1
> fcc0: 00000001 80282198 00000200 00000008 802933e8 00000000 10000000 6d5f76ba
> fce0: 00000000 00000000 00000002 000cae29 87bbdc80 0000000c 8011ecee 802a7d84
> fd00: 00000001 00000010 00000000 00000000 80037ae0 802a7d84 00000000 00000001
> fd20: 87ad3f4c 80039602 87bbdcc0 00000001 87bc0840 80039622 00000010 80039628
> fd40: 87bbdcc0 800034cc 80007740 87bbdcc0 00000001 87bc0840 8795b2c0 864ae000
> fd60: 800076c4 0000000c e0864ef0 ffffffff 00000001 00000000 87bbdcc0 00040000
> fd80: 864ae801 00000000 6d25e3d3 00000000 864ae000 8795b2c0 87bc0840 00000001
> fda0: 87bbdcc0 8027fdc4 8011956e 8011956c 40008101 29698470 00004437 00040000
> fdc0: ffffffff 8795b2c0 80119ca4 87bc0840 0000fffe 00000004 87bbdcc0 8027fe04
> fde0: 864ae000 8027fe8c 8027fe04 8027fe8c 00000004 8795b2c0 864ae000 0003ffec
> fe00: 87bbdcc0 00040044 00040050 0003fff8 00000001 00000000 00000001 00000000
> fe20: 0000000c 8011ce8e 8795b2c0 00000004 8027fe68 87bbdcc0 864ae000 87bc0840
> fe40: 0003fff8 8027fea4 8027fe9c 8027fe8c 8027fe98 00000004 00000000 8027fe94
> fe60: 7fd80170 7fd8016c 7fd80138 7fd80134 8027fecc 00000004 000002c0 0000000b
> fe80: 87a97200 00000000 20000000 6d25e3d3 00000000 00000008 00000002 00000000
> fea0: 87bbdcc0 0000000c 8011f84c 802a7d84 00000000 00000070 fd119014 87889e40
> fec0: 87831c20 87bb2e0c 00000004 87831c20 80192210 8016624e 87831b00 00370401
> fee0: 800379d6 00000000 87889e40 80288e18 87ad3eec 800395f0 802836a2 00000040
> ff00: 8028369c 00000100 00000070 80288e18 87889e40 8000ac18 0000001f 00000001
> ff20: 87815a80 0000002f 8001a796 87aaa600 8028369e 800034cc 87aaa600 802c22c0
> ff40: 8000f710 801eb64c 00000000 8029385c 00000040 80007746 8000f788 800034a4
> ff60: 400081f1 00000000 8027e000 8027e000 00000003 00000001 00000001 00000019
> ff80: 00000010 80003020 80060488 8000f788 801eb64c 8000f710 802c22c0 87aaa600
> ffa0: 8027ffc0 80003082 800030dc 40008101 29698470 00004437 00000000 ffffffff
> ffc0: 802a9934 801eaff8 802bd29b 802bccf4 80280840 80129ab0 80282dce 802a9284
> ffe0: 802bd198 00000000 87bd8a00 80037228 802c3658 80120ab6 0004bf6c 00000000
> Kernel panic - not syncing: Fatal exception in interrupt
>
--
Mathieu Desnoyers
OpenPGP key fingerprint: 8CD5 52C3 8E3C 4140 715F BA06 3F25 A8FE 3BAE 9A68
^ permalink raw reply [flat|nested] 5+ messages in thread
* [ltt-dev] Panic on SH with the Kernel 2.6.30.9
2010-01-07 15:23 ` Mathieu Desnoyers
@ 2010-01-07 15:34 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 5+ messages in thread
From: Giuseppe CAVALLARO @ 2010-01-07 15:34 UTC (permalink / raw)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi Mathieu,
Mathieu Desnoyers wrote:
> You should probably try lttng 0.170 for kernel 2.6.31.6 instead. This
> version fixed a lot of bugs discovered by heavy stress-testing.
>
> I think your problem comes from the new network synchronization markers
> added around there versions. They had incorrect type sizes for the event
> payload and therefore caused problems. They were fixed a few versions
> later. Just disabling the network "extra" instrumentation should also
> work.
Thanks for this info. Unfortunately, at this moment, I cannot test
lttng on a Kernel newer than the 2.6.30.9 but I'll let you know if I
have any progresses.
Thanks
Peppe
> Thanks,
>
> Mathieu
>
> * Giuseppe CAVALLARO (peppe.cavallaro at st.com) wrote:
> Hi Mathieu,
> using lttng-0.162 with an STLinux kernel 2.6.30.9, I get a panic (see
> the log attached).
> I work on an STM board with an SH4-300 CPU (128MiB RAM).
> I mount a rooFS via NFS and run the following commands before having the
> panic.
>
> $ ltt-armall
> $ lttctl -C -w /tmp/trace1 trace1 |-> ltt-control-0.75
> $ ls -lR / |-> After a few seconds I get
> |-> the panic.
>
> This is my Kernel configuration for LTT:
> CONFIG_LTT=y
> CONFIG_LTT_FILTER=y
> CONFIG_HAVE_LTT_DUMP_TABLES=y
> CONFIG_LTT_RELAY_ALLOC=y
> CONFIG_LTT_RELAY_LOCKLESS=y
> # CONFIG_LTT_RELAY_IRQOFF is not set
> # CONFIG_LTT_RELAY_LOCKED is not set
> CONFIG_LTT_SERIALIZE=y
> CONFIG_LTT_FAST_SERIALIZE=y
> CONFIG_LTT_TRACEPROBES=y
> CONFIG_LTT_TRACE_CONTROL=y
> CONFIG_LTT_TRACER=y
> CONFIG_LTT_ALIGNMENT=y
> CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y
> CONFIG_LTT_DEBUG_EVENT_SIZE=y
> CONFIG_LTT_USERSPACE_EVENT=y
> CONFIG_LTT_VMCORE=y
> CONFIG_LTT_STATEDUMP=y
> CONFIG_LTT_ASCII=y
>
> Problem happens when I turn-on LTT_TRACEPROBES at config time.
>
> Welcome advice.
>
> Regards,
> Peppe
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAktF/ugACgkQ2Xo3j31MSSKS3QCgjGXAQ3kDlVViSDq9H8Afo7MJ
PxEAn0VE2tyz6YnKPYOhnGB2MUquBvKL
=zeeb
-----END PGP SIGNATURE-----
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2010-01-07 15:34 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-01-07 15:11 [ltt-dev] Panic on SH with the Kernel 2.6.30.9 Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:11 ` Giuseppe CAVALLARO
2010-01-07 15:23 ` Mathieu Desnoyers
2010-01-07 15:34 ` Giuseppe CAVALLARO
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox