ephemeral404M to Data EngineeringEnglish · 2 years agoData Engineering roadmapimagemessage-square6fedilinkarrow-up113arrow-down11file-text
arrow-up112arrow-down1imageData Engineering roadmapephemeral404M to Data EngineeringEnglish · 2 years agomessage-square6fedilinkfile-text
minus-squareAndylinkfedilinkEnglisharrow-up1·2 years agoIsn’t Apache Arrow a table format rather than a batch processing tool? You could add SQLMesh as an alternative to dbt.
minus-squareephemeral404OPMlinkfedilinkEnglisharrow-up1·2 years agothanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html
Isn’t Apache Arrow a table format rather than a batch processing tool?
You could add SQLMesh as an alternative to dbt.
thanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html