Download as PDF, PPTX
More Related Content
Similar to Introduction to Python Asyncio
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
Introduction to Python Asyncio
- 1. AN INTRODUCTIONTO PYTHON ASYNCIO NathanVanGheem @vangheezy nathanvangheem.com Lead Platform Engineer @ Onna
- 2. ABOUT ME Plone corecontributor, framework, ui, sec teams, Developer of Guillotina, Lead Platform Engineer @ Onna
- 3. ASYNCIO,A DEFINITION “This moduleprovides infrastructure for writing single-threaded concurrent code using coroutines, multiplexing I/O access over sockets and other resources, running network clients and servers, and other related primitives” - https://docs.python.org/3/library/asyncio.html
- 4. ASYNC - IO Asynchronousprogramming using async/await syntax I/O with aTCP socket
- 5. WHAT DOES ITLOOK LIKE?
- 6. SO WHAT? Web applicationsuseTCP sockets A way to improve performance and scale web applications Also think micro services
- 7. BENEFITS The event loopallows you to handle a larger number of network connections at once.
- 8. BENEFITS Code does notblock on network activity, so you can have long running connections with very little performance impact(HTML5 sockets for example)
- 9. REQUIREMENTS Python >= 3.4 bestfeatures and performance in 3.6
- 10. HOWTYPICAL WEB SERVERS AREDESIGNED • Pyramid • Flask • Django • Plone • Etc..
- 11. User Request(Web Browser) WebApplication Use Available PythonThread Render Request Send Response to User(Web Browser) Start over
- 12. SERVING REQUESTS(LEGACY) Threads XProcesses = Number of simultaneous requests
- 13. THREADED MODEL AND WEBSOCKETS Not practical Can not keep threads open
- 14. THREADS AND PYTHON Threadsare expensive(GIL, context switching, CPU), Processes are expensive on RAM
- 15. WEB SERVERTHREADING MODEL… If nothreads available because they are busy, further requests are blocked, waiting for an open thread
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22. ASYNCIO SERVERS Block onCPU(obviously)
- 23. ASYNCIO SERVERS Can acceptmany simultaneous connections
- 24. ASYNCIO SERVERS No blockingon network traffic “reactive”
- 25.
- 26.
- 27. CPU ISTHE LIMIT LimitCPU intensive operations Scale with more processes, or with connected micro-services(network traffic)
- 28. DETAILS… In order tobenefit, the whole stack needs to be AsyncIO aware
- 29. NO - ASYNC- IO Anywhere in your application server that is not AsyncIO and does network traffic WILL BLOCK all other connections while it is doing it’s network traffic(example: using requests library instead of aiohttp)
- 30. GETTING STARTED 1. Getactive event loop or create new one 2. Run coroutine inside event loop with asyncio.run_until_complete
- 31.
- 32. AND WE HAVEFUTURES… asyncio.run_until_complete automatically wraps your coroutine into a Future object and waits for it to finish asyncio.ensure_future will wrap a coroutine in a future and return it to you So you can schedule multiple coroutines that can run at the same time
- 33.
- 34. TASKS You can alsoschedule long running tasks on the event loop Tasks are like futures Tasks are futures, but pluggable on the event loop with different implementations
- 35.
- 36. TASKS/FUTURES/COROUTINES Well, it’s abit odd we have distinctions Consider all of these synonyms until you dive deeper
- 37. GOTCHA: EVERYTHING MUST BEASYNC If you want part of your code to be async, the complete stack of the caller must be async and running on the event loop
- 38. ONCEYOU’RE ASYNC, YOU’RE GOOD Youcan also consider asyncio.run_until_complete as a sort of bootstrap function
- 39.
- 40. SINGLETHREADED Only 1 eventloop can run in a thread at a time Running multi-threaded code with AsyncIO code running in a thread loop is unsafe You can multi-(process|thread) and run multiple threads at the same time
- 41.
- 42. “MULTI” PROCESSING IN ASYNCIO asyncio.gatherallows you to run multiple coroutines at the same time, waiting for all of them to finish There are also async context managers
- 43.
- 44. LOOPS We can alsoutilize asyncio in for loops + yield
- 45.
- 46. SCHEDULING loop.call_later: arrange tocall function on a delay loop.call_at: arrange function to be called at specified time
- 47.
- 48. EXECUTORS An executor isavailable to use when you have non-async code that needs to be made async, or CPU intensive code A typical executor is a thread executor.This means, anything you run in an executor is being thrown in a thread to run. Try to avoid but it’s a tool available It’s worse to have non-async code than to use thread executors
- 49.
- 50. ASYNC SUBPROCESS The PythonAsyncIO library comes with an amazing subprocess module
- 51.
- 52. EVENT LOOP ISPLUGGABLE
- 53. ALTERNATIVE LOOP IMPLEMENTATIONS • uvloop •tokio(rust) • Curio
- 54. AWESOME AIO • aiohttp:client and server library • aioes: elastic search • asyncpg: postgresql • aioredis • aiobotocore • aiosmtpd: smtp • and many more. Check out https://github.com/aio-libs
- 55. DEBUGGING • Debugging ismore difficult than regular sequential programs • pdb(debugger) statements do not properly skip over await calls(because thread loop causes debugging to pay attention to another call stack) • pdb also causes thread loop to halt right there, there is no way to manually execute task in loop in a pdb prompt either • Making matters more annoying, python prompt doesn’t work with asyncio
- 56. DEBUGGINGTOOLS • aioconsole: allowsyou to have a python prompt with asyncio loop already setup for you. So you can run await statements! Guillotina runs it’s shell command in an aioconsole. • aiomonitor: attach to already running event loop and get info on running tasks.Also integrated with guillotina(run `g -m`)
- 57. GUILLOTINA! guillotina: full webapplication built with asyncio technologies. Lots of great examples
- 58. PYTHON 3.7 Execution context:like thread locals but for coroutines(right now with aiotask-context)
- 59.