From Data Pipeline to Airflow - the Obstacles in Our Migration

莊鐵鴻

莊鐵鴻

覺得有趣選了物理系,結果差點畢不了業。想做遊戲所以開始寫程式,結果沒進過遊戲公司。覺得電腦圖學好玩,結果接觸了電腦視覺。覺得機器學習很酷,結果待續。現在在 KKStream 披著 Android Adaptive Player 的皮,企圖跟同事強迫推銷自己都不太懂的演算法。

    Abstract

    We had in-house workflow schemas, we had in-house deployment tools, how could we migrate to Airflow with minimum changes. In this talk, I would like to share the obstacles we encountered and how we overcame them.

    Description

    Location

    R0

    Date

    Day 1 • 12:55-13:25 (GMT+8)

    Language

    English talk

    Level

    Novice

    Category

    Application