ephemeral404M to Data EngineeringEnglish · 1 year agoData Engineering roadmapimagemessage-square6fedilinkarrow-up113arrow-down11file-text
arrow-up112arrow-down1imageData Engineering roadmapephemeral404M to Data EngineeringEnglish · 1 year agomessage-square6fedilinkfile-text
minus-squareAndylinkfedilinkEnglisharrow-up1·1 year agoIsn’t Apache Arrow a table format rather than a batch processing tool? You could add SQLMesh as an alternative to dbt.
minus-squareephemeral404OPMlinkfedilinkEnglisharrow-up1·1 year agothanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html
Isn’t Apache Arrow a table format rather than a batch processing tool?
You could add SQLMesh as an alternative to dbt.
thanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html