Enum with `str` or `int` Mixin Breaking Change in Python 3.11
Python 3.11 was released almost two months ago and brought some great improvements to the Enum class. Unfortunately, there is also a breaking change. You might be impacted if you are using Enum classes with a str
/int
mixin:
from enum import Enum
class Foo(str, Enum):
BAR = "bar"
Foo.BAR
in Python 3.11 will no longer return the member value "bar"
when used in the format()
function or f-strings the way that prior Python versions used to. Instead, it will return the Foo.BAR
member class.
# Python 3.10
f"{Foo.BAR}" # > bar
# Python 3.11
f"{Foo.BAR}" # > Foo.BAR
If you have f"{Foo.BAR}"
in your code, it will likely break when you migrate to 3.11, so upgrade with caution.
The easiest way to fix it is to replace the str
mixin with the newly added StrEnum
class, but let’s take one step back and take a look at Enum classes and why my project ended up having more than 50 of them with the str
mixin.
Enum
Enum classes were introduced in Python 3.4 with PEP-435 to help developers define symbolic names for constant values. This is useful because having Foo.BAR
is much more readable than having the "bar"
constant spread across the codebase.
Enum classes do have some surprising behaviors. Let’s look at the example:
class Foo(Enum):
BAR = "bar"
If you try to use the BAR value in the code like this:
assert Foo.BAR == "bar"
You will receive an assertion error! This is because Foo.BAR
is not a str
instance as it might seem from the class definition. To get to the str
value you’d need to write:
assert Foo.BAR.value == "bar"
But knowing when to use .value
is inconvenient. Engineers will try to find a workaround. On my project the workaround was to add a str
mixin:
class Foo(str, Enum):
BAR = "bar"
This makes it seem like the problem is solved since assert Foo.BAR == "bar"
no longer raises an error (in Python 3.10 or older versions), but…
There be dragons!
This only works for f-strings and format functions. The old %
based str formatting syntax will still be broken. The str
function will also not return "bar"
. More examples in Python 3.10:
print(Foo.BAR) # > Foo.BAR
print(str(Foo.BAR)) # > Foo.BAR
print("%s" % Foo.BAR) # > Foo.BAR
print(f"{Foo.BAR}") # > bar
print("{}".format(Foo.BAR)) # > bar
This inconsistency was fixed in Python 3.11 and the output is now the same everywhere:
print(Foo.BAR) # > Foo.BAR
print(str(Foo.BAR)) # > Foo.BAR
print("%s" % Foo.BAR) # > Foo.BAR
print(f"{Foo.BAR}") # > Foo.BAR
print("{}".format(Foo.BAR)) # > Foo.BAR
Consistency is always good! But this fix was what broke our code.
We were expecting "bar"
but were now getting Foo.BAR
! So now we are back on square one. In the cases above Foo(str, Enum)
behaves the same as Foo(Enum)
. So how can we avoid writing .value
everywhere?
StrEnum to the rescue
Luckily, there is a solution for this in Python 3.11. The newly added StrEnum class! Now we can write:
from enum import StrEnum
class Foo(StrEnum):
BAR = "bar"
And the results are going to be exactly what we originally wanted with the str
mixin, except that it’s going to work consistenlty for all cases that I could come up with:
print(Foo.BAR) # > bar
print(str(Foo.BAR)) # > bar
print("%s" % Foo.BAR) # > bar
print(f"{Foo.BAR}") # > bar
print("{}".format(Foo.BAR)) # > bar
Python 3.10 or older
If you want to stop using the str
mixin and aren’t quite ready to upgrade to Python 3.11 yet, I suggest you check out the StrEnum
PyPi package. For the examples above, it behaves the same as Python 3.11, you just need to import StrEnum
from strenum
instead of enum
.
from strenum import StrEnum
class Foo(StrEnum):
BAR = "bar"
You can keep using the StrEnum package even after you upgrade to Python 3.11, it even has some extra features that the standard library StrEnum
version doesn’t have.
“What’s New In Python 3.11” Page
The “What’s New In Python 3.11” page seems to have a small mistake in the changelog that describes this change:
Changed Enum.format() (the default for format(), str.format() and f-strings) of enums with mixed-in types (e.g. int, str) to also include the class name in the output, not just the member’s key. This matches the existing behavior of enum.Enum.str(), returning e.g. ‘AnEnum.MEMBER’ for an enum AnEnum(str, Enum) instead of just ‘MEMBER’.
Unless I’m misunderstanding something, the documentation should state that the format function and f-strings were returning the MEMBER value and not just the MEMBER without the class. I’ve opened a PR in the CPython project to see if we can clear this up a little bit.
Fin
I was avoiding the use of Enum
s because of the gotchas outlined in this post, but I do like how the new StrEnum
(and IntEnum
) classes work and I think I’ll be using them a lot more going forward 🎉
Do you have a better way of dealing with Enum classes? Send a toot, tweet, email, or open a PR and I’ll update the blog post with your idea.