Language
Taiwanese Hokkien
Category
Best Practices & Patterns
Python Level
Intermediate
Slides Link
Abstract
In this talk, I will introducing Mass, a Python package, that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, (visualization), handling failures, command line integration, and much more. If you are working in cloud computing and searching for no centralized server, pythonic, and on-premise/cloud-based mixed solution, welcome to join us!
Description
In this talk, I will introducing Mass, a Python package, that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, (visualization), handling failures, command line integration, and much more.
The purpose of Mass is to address all the plumbing typically associated with long-running batch processes. You want to chain many tasks, automate them, and failures will happen. These tasks can be anything, but are typically long running things like video encoding, rendering for computer graphics, DB dump, or complex algorithm on big data.
The main features of Mass:
* No centralized server.
* Pythonic code snippets to represent a job
* On-premise, cloud-based or even mixed mass workers are allowed.
Let's start your mass job and enjoy it!
林進錕
正在嘗試種稻、種菜、追求自給自足生活的宜蘭農夫、在社運場合出沒的樂團主唱、只會爬垂直面的攀岩教練、靜態水域沒辦法滑直線的獨木舟玩家、和朋友出過一本書的業餘作家。
我是林進錕,有一個台灣獨立建國的夢。
喔對了,我寫Python。