ez-a-sync is a Python library that enables developers to write both synchronous and asynchronous code without having to write redundant code. It provides a decorator @a_sync(), as well as a base class ...

Py03 unlocks the GIL, which is great. Most LLM inference servers have many cores (>200), but are blocked by the GIL. Also, most servers are async, by nature that python thread based parallelism isn't ...