Warp Solutions: Parquet <-> WarpStream
1 month ago
2
Series: Warp Solutions
Subject: Use Bento and WarpStream to Parquet and query with DuckDB
Apache Parquet is an open-source, column-oriented data file format designed for efficient data storage and retrieval. It forms the backbone of many datalake and table format systems. In this Solution, Shawn will create a small pipeline script with the popular open-source Bento tool, to read from a topic in a WarpStream cluster, and write batches of Parquet files which are then queried with #DuckDB.
WarpStream - www.warpstream.com
Parquet - parquet.apache.org
Bento docs - https://warpstreamlabs.github.io/bento/docs/guides/getting_started/
#apachekafka #apacheiceberg #parquet #datastreaming #dataengineering #duckdb #bento
Loading comments...
-
LIVE
Ashaelon
5 hours ago $1.82 earnedBorderlands - The Pre-Sequel! - First Full Playthrough #4
814 watching -
5:00:48
Fairy Mysterious
5 hours agoIcarus gameplay with friends Episode 1
39.9K4 -
LIVE
a12cat34dog
6 hours agoPS2 HORROR CLASSIC :: The Suffering :: FINISHING THIS 2004 GEM {18+}
876 watching -
5:33:32
G2G Gaming Channel
6 hours agoYou relax/I Smite! #RumbleTakeOver
32.6K1 -
5:50:03
ConfusedCoast/Coast Chan VTUBER
12 hours ago(VTUBER) - BLACK OPS 6 CAMPAIGN PLAYTHROUGH - RUMBLE
24.3K3 -
5:27:17
FusedAegisTV
8 hours ago『SCH lvl 100』Weekend Raid & Rant | Final Fantasy XIV | Trump x Rogan Interview REACTION
19.6K3 -
4:31:55
Random Kiwi Gamer
8 hours agoFor SCIENCE!!! | Abiotic Factor
15.7K -
5:14:10
Rance's Gaming Corner
5 hours ago"Greater love has no one than this, than to lay down one’s life for his friends."
13.2K1 -
5:15:44
MissesMaam
6 hours ago#RumbleHangover 💚✨
13.3K5 -
1:34:16
Amish Zaku
5 hours agoWar Thunder
15.6K1