Re: radosgw hammer -> jewel upgrade (default zone & region config)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I finally managed to fix the problem with the radosgw upgrade to jewel with the 
help of the script from Yehuda 
(https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/).

I tested the whole upgrade on our staging cluster first.

As already mentioned I removed the '_' in the "filter_json" function.

I also replaced:
"""
$RADOS mkpool .rgw.root
"""

with:

"""
ceph osd pool create .rgw.root <pg num of the current .rgw.root pool>
"""

After running the script I had to restart all the radosgw instances. Which 
left me with one error in the radosgw.log :

"""
2016-05-23 17:37:59.488478 7f6375719900 -1 rgw period pusher: The new period 
does not contain my zonegroup!
"""

I executed the following to fix this issue:
$> radosgw-admin period update --commit

After another restart of all radosgw instances I had no error messages  in the 
radosgw.log anymore.

On production I executed all the stuff during a downtime of all radosgw 
instances to be safe :-)

The cluster looks good now and all user operations (like bucket creation, 
quota change, etc) are possible again.


Cheers
Nick

On Monday, May 23, 2016 10:41:12 AM Ben Hines wrote:
> I for one am terrified of upgrading due to these messages (and indications
> that the problem still may not be resolved even in 10.2.1) - holding off
> until a clean upgrade is possible without running any hacky scripts.
> 
> -Ben
> 
> On Mon, May 23, 2016 at 2:23 AM, nick <nick@xxxxxxx> wrote:
> > Hi,
> > we ran into the same rgw problem when updating from infernalis to jewel
> > (version 10.2.1). Now I would like to run the script from Yehuda, but I am
> > a
> > bit scared by
> > 
> > >I can create and get new buckets and objects but I've "lost" all my
> > >
> > > old buckets.
> > 
> > As I understood so far we do not need the trailing underscores from the
> > script
> > when upgrading directly to 10.2.1. Is this correct?
> > 
> > I guess the trailing underscore gets created in that script line
> > (filter_json
> > function):
> > """
> > echo \"$key\": \"${val}_\", >> $out_file
> > """
> > 
> > Should I remove the 'underscore' there?
> > 
> > Thanks for any help :-)
> > 
> > Cheers
> > Nick
> > 
> > On Friday, May 20, 2016 01:28:07 PM Jonathan D. Proulx wrote:
> > > On Fri, May 20, 2016 at 09:21:58AM -0700, Yehuda Sadeh-Weinraub wrote:
> > > :On Fri, May 20, 2016 at 9:03 AM, Jonathan D. Proulx <jon@xxxxxxxxxxxxx>
> > 
> > wrote:
> > > :> Hi All,
> > > :> 
> > > :> I saw the previous thread on this related to
> > > :> http://tracker.ceph.com/issues/15597
> > > :> 
> > > :> and Yehuda's fix script
> > 
> > https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/
> > 
> > > :> fix-zone
> > > :> 
> > > :> Running this seems to have landed me in a weird state.
> > > :> 
> > > :> I can create and get new buckets and objects but I've "lost" all my
> > > :> old buckets.  I'm fairly confident the "lost" data is in the
> > > :> .rgw.buckets pool but my current zone is set to use .rgw.buckets_
> > > 
> > > <snip>
> > > 
> > > :> Should I just adjust the zone to use the pools without trailing
> > > :> slashes?  I'm a bit lost.  the last I could see from running the
> > > :
> > > :Yes. The trailing slashes were needed when upgrading for 10.2.0, as
> > > :there was another bug, and I needed to add these to compensate for it.
> > > :I should update the script now to reflect that fix. You should just
> > > :update the json and set the zone appropriately.
> > > :
> > > :Yehuda
> > > 
> > > That did the trick (though obviously we both meant trailing
> > > underscores '_')
> > > 
> > > Thanks,
> > > -Jon
> > > _______________________________________________
> > > ceph-users mailing list
> > > ceph-users@xxxxxxxxxxxxxx
> > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> > 
> > --
> > Sebastian Nickel
> > Nine Internet Solutions AG, Albisriederstr. 243a, CH-8047 Zuerich
> > Tel +41 44 637 40 00 | Support +41 44 637 40 40 | www.nine.ch
> > _______________________________________________
> > ceph-users mailing list
> > ceph-users@xxxxxxxxxxxxxx
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 
-- 
Sebastian Nickel
Nine Internet Solutions AG, Albisriederstr. 243a, CH-8047 Zuerich
Tel +41 44 637 40 00 | Support +41 44 637 40 40 | www.nine.ch

Attachment: signature.asc
Description: This is a digitally signed message part.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux