Hamburger nav causing drop in organic traffic?

[SoulSurfer8]

This may sound crazy but is it possible a hamburger nav used on a desktop responsive site could lead to a drop in organic traffic? Our hamburger nav requires between 3-4 clicks to arrive on a subpage. Here's an example of necessary clicks for a given page:

1. click hamburger menu2) resorts (expands resorts nav)
2. city (expands various cities where our resorts are located)
3. actual resort (this opens up resort menu)
4. resort overview (first clickable link)

Is there any way we're getting penalized for excessive number of clicks? All our old pages were 301 redirected and content is relatively the same on the new redesigned website.

Thanks

[Highland]

I think your answer is in the question

All our old pages were 301 redirected and content is relatively the same on the new redesigned website.

So if you recently remodeled and redid your URLs that's a much more likely suspect in your drop. 301s past most, but not necessarily all, page juice