Ceph: properly remove an OSD
Sometimes removing OSD, if not done properly can result in double rebalancing. The best practice to remove an OSD involves changing the crush weight to 0.0 as first step.
So in the end, this will give you:
$ ceph osd crush reweight osd.<ID> 0.0
Then you wait for rebalance to be completed. Eventually completely remove the OSD:
$ ceph osd out <ID>
Et voilà !