From: Benjamin Woodruff <github@benjam.info>
Date: Wed, 8 May 2019 19:06:44 +0000 (-0400)
Subject: Add support for always tokenizing async/await as keywords
X-Git-Url: https://git.madduck.net/etc/vim.git/commitdiff_plain/f8617f975d56e81cfb4070ce65584f7b29a77e7a?ds=sidebyside;hp=f8617f975d56e81cfb4070ce65584f7b29a77e7a

Add support for always tokenizing async/await as keywords

Fixes #593

I looked into this bug with @ambv and @carljm, and we reached the
conclusion was that it's not possible for the tokenizer to determine if
async/await is a keyword inside all possible generators without breaking
the grammar for older versions of Python.

Instead, we introduce a new tokenizer mode for Python 3.7+ that will
cause all async/await instances to get parsed as a reserved keyword,
which should fix async/await inside generators.
---