Action mode bar pushing down the Toolbar

In my app I'm using the Toolbar as explained in the official documentation (v7 appcompat support library, Theme.Appcompat.Light.NoActionBar, android.support.v7.widget.Toolbar, setSupportActionBar(myToolbar)): http://developer.android.com/training/appbar/index.html

I have an ExpandableListView and I'd like to implement the contextual action mode when I long-click on an item. To achieve this I use: setMultiChoiceModeListener(new MultiChoiceModeListener()). This way, however, the action mode bar is displayed at the top of the screen, pushing down the Toolbar (I think it's because the system uses the ordinary action mode, and not the support action mode). I want it to be displayed on the Toolbar.

I tried this solution: windowActionBarOverlay = true but it doesn't work.

from Action mode bar pushing down the Toolbar