Re: 0.40 OSD - Address family not supported by protocol

[Sage Weil <sage@xxxxxxxxxxxx>]

Hi Josh,

On Sat, 14 Jan 2012, Josh Pieper wrote:
> I just upgraded our test cluster to 0.40, and immediately after
> starting up get asserts in all the OSDs.  I've inlined a relevant
> backtrace below, is there anything else that would be useful for
> debugging?

Are you coming from 0.39 or something older?

You might try reverting 4728f4f8e09878c583c65cd882e031d37f8d903e and see 
if that does it..

Can you reproduce it with --debug-osd 10 and --debug-ms 10?

sage

> 
> Our test cluster is 3 ubuntu 11.10 amd64 machines, each with a mon and
> osd.
> 
> Looking at an strace, it is pretty clearly asking for an invalid
> address family, although I'm not sure where it is coming from.
> 
> [pid 30648] socket(PF_UNSPEC, SOCK_STREAM, 0 <unfinished ...>
> [pid 30648] <... socket resumed> )      = -1 EAFNOSUPPORT (Address family not supported by protocol)
> 
> -Josh
> 
> -------
> 2012-01-14 09:31:03.395266 7f67edf08700 -- 10.1.10.71:6801/27529 >> 10.1.10.73:6801/8127 pipe(0x14e0780 sd=19 pgs=0 cs=0 l=0).connect claims to be 10.1.10.73:6801/24029 not 10.1.10.73:6801/8127 - wrong node!
> 2012-01-14 09:31:03.395579 7f67ede07700 -- :/27530 >> :/0 pipe(0x14e0500 sd=-1 pgs=0 cs=0 l=0).connect couldn't created socket Address family not supported by protocol
> msg/SimpleMessenger.cc: In function 'int SimpleMessenger::Pipe::connect()', in thread '7f67ede07700'
> msg/SimpleMessenger.cc: 1038: FAILED assert(0)
>  ceph version 0.40 (commit:7eea40ea37fb3a68a2042a2218c9b8c9c40a843e)
>  1: (SimpleMessenger::Pipe::connect()+0x87c) [0x5be81c]
>  2: (SimpleMessenger::Pipe::writer()+0x456) [0x5c1536]
>  3: (SimpleMessenger::Pipe::Writer::entry()+0xd) [0x4b228d]
>  4: (()+0x7efc) [0x7f67ffdf4efc]
>  5: (clone()+0x6d) [0x7f67fe42589d]
>  ceph version 0.40 (commit:7eea40ea37fb3a68a2042a2218c9b8c9c40a843e)
>  1: (SimpleMessenger::Pipe::connect()+0x87c) [0x5be81c]
>  2: (SimpleMessenger::Pipe::writer()+0x456) [0x5c1536]
>  3: (SimpleMessenger::Pipe::Writer::entry()+0xd) [0x4b228d]
>  4: (()+0x7efc) [0x7f67ffdf4efc]
>  5: (clone()+0x6d) [0x7f67fe42589d]
> *** Caught signal (Aborted) **
>  in thread 7f67ede07700
>  ceph version 0.40 (commit:7eea40ea37fb3a68a2042a2218c9b8c9c40a843e)
>  1: /usr/bin/ceph-osd() [0x5fd926]
>  2: (()+0x10060) [0x7f67ffdfd060]
>  3: (gsignal()+0x35) [0x7f67fe37a3a5]
>  4: (abort()+0x17b) [0x7f67fe37db0b]
>  5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f67fec38d7d]
>  6: (()+0xb9f26) [0x7f67fec36f26]
>  7: (()+0xb9f53) [0x7f67fec36f53]
>  8: (()+0xba04e) [0x7f67fec3704e]
>  9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x193) [0x5cfd33]
>  10: (SimpleMessenger::Pipe::connect()+0x87c) [0x5be81c]
>  11: (SimpleMessenger::Pipe::writer()+0x456) [0x5c1536]
>  12: (SimpleMessenger::Pipe::Writer::entry()+0xd) [0x4b228d]
>  13: (()+0x7efc) [0x7f67ffdf4efc]
>  14: (clone()+0x6d) [0x7f67fe42589d]
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html