Skip to content

docs: if you add_column, then you have to backfill instead of refresh#201

Merged
dantasse merged 1 commit intomainfrom
dantasse/backfill-not-refresh
Apr 3, 2026
Merged

docs: if you add_column, then you have to backfill instead of refresh#201
dantasse merged 1 commit intomainfrom
dantasse/backfill-not-refresh

Conversation

@dantasse
Copy link
Copy Markdown
Contributor

@dantasse dantasse commented Apr 3, 2026

Fixes https://linear.app/lancedb/issue/GEN-432/docs-update-udtf-doc-so-add-columns-does-a-backfill-not-a-refresh

It's not 100% ideal, because if you do:

clips = db.create_materialized_view(
    "clips",
    query=videos.search(None).select(["video_path", "metadata"]),
    udtf=extract_clips,
)
clips.refresh()
clips.add_columns({"embedding": clip_embedding})
clips.backfill("embedding")

then later add more rows to videos and run clips.refresh(), clips will have clips from the newly added videos, but will not have embedding filled in, and people might expect that they would. But I think it's comprehensible enough - like "refresh()" can't "just magically fix everything in the downstream table."

@mintlify
Copy link
Copy Markdown
Contributor

mintlify bot commented Apr 3, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
lancedb-bcbb4faf 🟢 Ready View Preview Apr 3, 2026, 2:17 PM

@dantasse
Copy link
Copy Markdown
Contributor Author

dantasse commented Apr 3, 2026

Oh, doesn't require a review - I'll just merge it. Lmk all if this is not what you want in the future.

@dantasse dantasse merged commit 18ba1ac into main Apr 3, 2026
2 checks passed
@dantasse dantasse deleted the dantasse/backfill-not-refresh branch April 3, 2026 17:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant