sfrt.io
sfrt.io
Actively hiring
Data Engineering
Follow
Overview
News
Technologies
Salaries
Products
People
Growth
Financials
Overview
Consider this my personal public notebook If you subscribe, you'll get email newsletters about new content when it's available.Get in [email protected].
News
Snowflake data movement policies: the copy path gets a guardrail
TL/DR: data movement policies hit general availability in Snowflake on Aug 19. One rule per movement type sets a row budget, policies bundle rules and hang off tags, with three possible outcomes: block, alert, or allow.Governance in Snowflake had an asymm
Read more
Report
dltHub notifies Slack and email. But my org runs on Teams
TL/DR: dltHub ships built-in notifications for Slack and email. Nice! But my org (for better or worse) runs on Microsoft Teams (well, ok, mostly worse...). So I built a small helper that mirrors the pattern, then shadowed the @job decorator so all my pipe
Read more
Report
7 shared modules for 27 dlt pipelines
TL/DR: nothing in dlt or dltHub stops pipeline files from importing a shared helper module... After all, it's plain Python I run seven of them at my workspace root and they carry 27 pipelines.My dltHub workspace has grown to roughly 70 jobs. Four of them
Read more
Report
LinkedIn Ads Snowflake, with 3-legged OAuth in the middle
TL/DR: LinkedIn Marketing APIs require 3-legged OAuth, which means a human in a browser. Scheduled pipelines don't have browsers. I store the refresh token in Snowflake.I built a dlt pipeline to load LinkedIn Ads data into Snowflake. It runs on a schedule
Read more
Report
I migrated a Fivetran pipeline to dltHub for $0.65
TL/DR: I replaced one daily Fivetran MySQL sync with dltHub in about an hour. OpenCode running Minimax M3 (because multimodal and still cheap ) consumed $0.65 in tokens. I gave it five manual inputs. One was actual infrastructure work. The other four were
Read more
Report
Pro access
Upgrade to see all 15 mentions
Upgrade to a paid plan to read every media mention of this company - funding news, awards, product launches and press releases from all the outlets writing about it.
Every media mention and press release
Funding news, awards and product launches
Fresh coverage from every outlet writing about the company
Upgrade now
Cancel anytime. Secure checkout. Instant activation.