cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
867
Views
0
Helpful
2
Replies

CallManger service crash CoreDump

BorisRus
Level 1
Level 1

Good day. in UCM 10.5.2 I get a crash of the CallManager service
RTMT:
CoreDetails: The following lists up to 6 cores dumped by corresponding applications.
Core1: Cisco CallManager (core.6813.11.ccm.1621943353) AppID: Cisco Log Partition Monitoring Tool ClusterID:
NodeID: ccm01

----

dmin:utils core active analyze core.6813.11.ccm.1621943353

This command may use a considerable amount of I/O
and running it may impact system performance.

It is highly recommended that this command be
run off-hours.

Continue (y/n)?y
Reading symbols from /usr/local/cm/bin/ccm...done.
[New Thread 13624]
[New Thread 13626]
[New Thread 13632]
[New Thread 13639]
[New Thread 13633]
[New Thread 13635]
[New Thread 13646]
[New Thread 13636]
[New Thread 13637]
[New Thread 13650]
[New Thread 13651]
[New Thread 13640]
[New Thread 13652]
[New Thread 13641]
[New Thread 13653]
[New Thread 13649]
[New Thread 13662]
[New Thread 13654]
[New Thread 13655]
[New Thread 13665]
[New Thread 13667]
[New Thread 13658]
[New Thread 13668]
[New Thread 13663]
[New Thread 11988]
[New Thread 13666]
[New Thread 11997]
[New Thread 6813]
[New Thread 11998]
[New Thread 11991]
[New Thread 13078]
[New Thread 13345]
[New Thread 13079]
[New Thread 13350]
[New Thread 13346]
[New Thread 13369]
[New Thread 13627]
[New Thread 13625]
[New Thread 13349]
[New Thread 13347]
[New Thread 13634]
[New Thread 13344]
[New Thread 11999]
[New Thread 13669]
[New Thread 13348]
[New Thread 13623]
[New Thread 13664]
[New Thread 13631]
Reading symbols from /usr/local/cm/lib/libuuidpp.so...done.
Loaded symbols for /usr/local/cm/lib/libuuidpp.so
Reading symbols from /usr/local/cm/lib/libJNIPIWriter.so...done.
Loaded symbols for /usr/local/cm/lib/libJNIPIWriter.so
Reading symbols from /usr/local/cm/lib/libssl.so.1.0.1...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/lib/libssl.so.1.0.1
Reading symbols from /usr/local/cm/lib/libcurl_cisco.so.4...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/lib/libcurl_cisco.so.4
Reading symbols from /usr/local/cm/lib/libpcre.so.0...done.
Loaded symbols for /usr/local/cm/lib/libpcre.so.0
Reading symbols from /usr/local/cm/lib/libdbnotify.so...done.
Loaded symbols for /usr/local/cm/lib/libdbnotify.so
Reading symbols from /usr/local/cm/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/cm/lib/libldap-2.4.so.2
Reading symbols from /usr/local/cm/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/cm/lib/liblber-2.4.so.2
Reading symbols from /usr/local/cm/lib/libdbl.so...done.
Loaded symbols for /usr/local/cm/lib/libdbl.so
Reading symbols from /usr/local/cm/lib/libpreferences.so...done.
Loaded symbols for /usr/local/cm/lib/libpreferences.so
Reading symbols from /usr/local/cm/lib/libodbc++-mt.so.4...done.
Loaded symbols for /usr/local/cm/lib/libodbc++-mt.so.4
Reading symbols from /usr/local/cm/db/informix/lib/cli/libifdmr.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/db/informix/lib/cli/libifdmr.so
Reading symbols from /usr/local/cm/db/informix/lib/cli/libthcli.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/db/informix/lib/cli/libthcli.so
Reading symbols from /usr/local/cm/db/informix/lib/esql/libifgls.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/libifgls.so
Reading symbols from /usr/local/cm/lib/libCryptoUtil.so...done.
Loaded symbols for /usr/local/cm/lib/libCryptoUtil.so
Reading symbols from /usr/local/cm/lib/libcrypto.so.1.0.1...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/lib/libcrypto.so.1.0.1
Reading symbols from /usr/local/cm/lib/libxerces-c.so.27...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/lib/libxerces-c.so.27
Reading symbols from /usr/local/platform/lib/libACE.so.6.1.1...done.
Loaded symbols for /usr/local/platform/lib/libACE.so.6.1.1
Reading symbols from /usr/local/cm/lib/libstlport.so.5.2...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/lib/libstlport.so.5.2
Reading symbols from /lib/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /usr/local/platform/lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/local/platform/lib/libz.so.1
Reading symbols from /lib/libattr.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libattr.so.1
Reading symbols from /lib/libcap.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libcap.so.2
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/librt.so.1
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /usr/local/cm/db/informix/lib/esql/libifglx.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/libifglx.so
Reading symbols from /lib/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /usr/lib/libstdc++.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /usr/lib/libfreebl3.so...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libfreebl3.so
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /usr/local/cm/db/informix/lib/esql/igo4a304.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/cm/db/informix/lib/esql/igo4a304.so
Reading symbols from /lib/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_dns.so.2
Core was generated by `/usr/local/cm/bin/ccm'.
Program terminated with signal 11, Segmentation fault.
#0 0xf6a07a88 in free () from /lib/libc.so.6

====================================
backtrace - CUCM
===================================
#0 0xf6a07a88 in free () from /lib/libc.so.6
#1 0xf6be81f2 in operator delete(void*) () from /usr/local/cm/lib/libstlport.so.5.2
#2 0x08d59bef in ~Array (this=0xe1363cd8, __in_chrg=<value optimized out>) at /view/BLD-cm_10_5_2-cct-ccm-d/vob/ccm/Common/Include/Utilities/Array.hpp:272
#3 ~AudioCapStructArray (this=0xe1363cd8, __in_chrg=<value optimized out>) at /view/BLD-cm_10_5_2-cct-ccm-d/vob/ccm/Common/Include/CallManager/TDCLCommonDataTypes.hpp:1448
#4 ~IFOpaqueData (this=0xe1363cd8, __in_chrg=<value optimized out>) at ../Include/TDCLMXsigs.hpp:13699
#5 MediaExchange::~MediaExchange (this=0xe1363cd8, __in_chrg=<value optimized out>) at ProcessMX.cpp:226
#6 0x08d59e02 in MediaExchange::~MediaExchange (this=0xe1363cd8, __in_chrg=<value optimized out>) at ProcessMX.cpp:238
#7 0x09ddb4fb in SdlRouter::scheduler (this=0xd3d6928) at SdlRouter.cpp:153
#8 0x09ddba6f in SdlRouter::schedulerInit (sdlRouter=0xd3d6928) at SdlRouter.cpp:107
#9 0xf6974b39 in start_thread () from /lib/libpthread.so.0
#10 0xf6a74c1e in clone () from /lib/libc.so.6
====================================
info registers
====================================
eax 0x0 0
ecx 0x40 64
edx 0x38 56
ebx 0xf6b23ff4 -156090380
esp 0xed4edc74 0xed4edc74
ebp 0xed4edc88 0xed4edc88
esi 0xe0109bc8 -535782456
edi 0x1cc 460
eip 0xf6a07a88 0xf6a07a88 <free+56>
eflags 0x10202 [ IF RF ]
cs 0x23 35
ss 0x2b 43
ds 0x2b 43
es 0x2b 43
fs 0x0 0
gs 0x63 99
====================================
info threads
====================================
48 Thread 0xeb30bb70 (LWP 13631) 0xf77ae430 in __kernel_vsyscall ()
47 Thread 0xe58c6b70 (LWP 13664) 0xf77ae430 in __kernel_vsyscall ()
46 Thread 0xed6e2b70 (LWP 13623) 0xf77ae430 in __kernel_vsyscall ()
45 Thread 0xf0b8eb70 (LWP 13348) 0xf77ae430 in __kernel_vsyscall ()
44 Thread 0xe4d2fb70 (LWP 13669) 0xf77ae430 in __kernel_vsyscall ()
43 Thread 0xf59ffb70 (LWP 11999) 0xf77ae430 in __kernel_vsyscall ()
42 Thread 0xf135eb70 (LWP 13344) 0xf77ae430 in __kernel_vsyscall ()
41 Thread 0xead2fb70 (LWP 13634) 0xf77ae430 in __kernel_vsyscall ()
40 Thread 0xf0d82b70 (LWP 13347) 0xf77ae430 in __kernel_vsyscall ()
39 Thread 0xf099ab70 (LWP 13349) 0xf77ae430 in __kernel_vsyscall ()
38 Thread 0xed2fab70 (LWP 13625) 0xf77ae430 in __kernel_vsyscall ()
37 Thread 0xeb4ffb70 (LWP 13627) 0xf77ae430 in __kernel_vsyscall ()
36 Thread 0xf05b2b70 (LWP 13369) 0xf77ae430 in __kernel_vsyscall ()
35 Thread 0xf0f76b70 (LWP 13346) 0xf77ae430 in __kernel_vsyscall ()
34 Thread 0xf07a6b70 (LWP 13350) 0xf77ae430 in __kernel_vsyscall ()
33 Thread 0xf1552b70 (LWP 13079) 0xf77ae430 in __kernel_vsyscall ()
32 Thread 0xf116ab70 (LWP 13345) 0xf77ae430 in __kernel_vsyscall ()
31 Thread 0xf1746b70 (LWP 13078) 0xf77ae430 in __kernel_vsyscall ()
30 Thread 0xf63ffb70 (LWP 11991) 0xf77ae430 in __kernel_vsyscall ()
29 Thread 0xf5d0bb70 (LWP 11998) 0xf77ae430 in __kernel_vsyscall ()
28 Thread 0xf67be710 (LWP 6813) 0xf77ae430 in __kernel_vsyscall ()
27 Thread 0xf5effb70 (LWP 11997) 0xf77ae430 in __kernel_vsyscall ()
26 Thread 0xe530bb70 (LWP 13666) 0xf77ae430 in __kernel_vsyscall ()
25 Thread 0xf67aeb70 (LWP 11988) 0xf77ae430 in __kernel_vsyscall ()
24 Thread 0xe5b0bb70 (LWP 13663) 0xf77ae430 in __kernel_vsyscall ()
23 Thread 0xe4f23b70 (LWP 13668) 0xf77ae430 in __kernel_vsyscall ()
22 Thread 0xe82ffb70 (LWP 13658) 0xf77ae430 in __kernel_vsyscall ()
21 Thread 0xe5117b70 (LWP 13667) 0xf77ae430 in __kernel_vsyscall ()
20 Thread 0xe54ffb70 (LWP 13665) 0xf77ae430 in __kernel_vsyscall ()
19 Thread 0xe89ffb70 (LWP 13655) 0xf77ae430 in __kernel_vsyscall ()
18 Thread 0xe93cbb70 (LWP 13654) 0xf77ae430 in __kernel_vsyscall ()
17 Thread 0xe5cffb70 (LWP 13662) 0xf77ae430 in __kernel_vsyscall ()
16 Thread 0xe9d8fb70 (LWP 13649) 0xf77ae430 in __kernel_vsyscall ()
15 Thread 0xe95bfb70 (LWP 13653) 0xf77ae430 in __kernel_vsyscall ()
14 Thread 0xea177b70 (LWP 13641) 0xf77ae430 in __kernel_vsyscall ()
13 Thread 0xe97b3b70 (LWP 13652) 0xf77ae430 in __kernel_vsyscall ()
12 Thread 0xea36bb70 (LWP 13640) 0xf77ae430 in __kernel_vsyscall ()
11 Thread 0xe99a7b70 (LWP 13651) 0xf77ae430 in __kernel_vsyscall ()
10 Thread 0xe9b9bb70 (LWP 13650) 0xf77ae430 in __kernel_vsyscall ()
9 Thread 0xea753b70 (LWP 13637) 0xf77ae430 in __kernel_vsyscall ()
8 Thread 0xea947b70 (LWP 13636) 0xf77ae430 in __kernel_vsyscall ()
7 Thread 0xe9f83b70 (LWP 13646) 0xf77ae430 in __kernel_vsyscall ()
6 Thread 0xeab3bb70 (LWP 13635) 0xf77ae430 in __kernel_vsyscall ()
5 Thread 0xeaf23b70 (LWP 13633) 0xf77ae430 in __kernel_vsyscall ()
4 Thread 0xea55fb70 (LWP 13639) 0xf77ae430 in __kernel_vsyscall ()
3 Thread 0xeb117b70 (LWP 13632) 0xf77ae430 in __kernel_vsyscall ()
2 Thread 0xebbffb70 (LWP 13626) 0xf77ae430 in __kernel_vsyscall ()
* 1 Thread 0xed4eeb70 (LWP 13624) 0xf6a07a88 in free () from /lib/libc.so.6

admin:

----

Can you help me figure out what the problem is?

 

2 Replies 2

Recommend you to open a case with TAC to have them look into this.



Response Signature


m.cucchi
Level 1
Level 1

hello Boris have you find the solution with cisco TAC ? 

Thank you

Massimo