r/dataengineering - Reddit

Snowflake is easy to use. As you mature and scale, Databricks becomes a strong competitor capable of more use cases. I consider both to have a reasonable moat against AI/LLMs, which is data governance with data lineage. I expect that moat to last at least a few years... even though most companies aren’t mature enough to have a strong data governanc... See more

My top issues with the foundations of the "modern data stack":

• Snowflake - you may only pay for what you use, but you pay through the nose for it. The cost is so high that in many cases it can exceed the cost of binders full of dbas.


• Fivetran - convenient, but they tried to triple my licensing cost last year, they have almost constant 15 minute o

... See more