Oh ginger! Have your tried Haloes? Notes are-Oak, tonka, vanilla, white sandalwood, lily of the valley, white ginger, amber, and apricot.
It definitely has the sweet aspect and the ginger is very prominent. I feel like this would be perfect for you. It's currently sold out from where it's retailed but it shouldn't be too hard to find plus it will be restocked eventually.