The Feldera Blog

An unbounded stream of technical articles from the Feldera team

Implementing Batch Processes with Feldera

Feldera performs incremental computation (as we described previously). As new data arrives, it reuses work from its previous computations to efficiently update query results used by batch jobs. As the database grows, the time to update query results grows much more slowly than for queries in a database, because it can reuse much of the work from the previous runs. Feldera turns time-consuming database batch jobs into fast incremental updates.

Incremental Update 12

Smarter Compilation Caching! A quick overview of what's new in v0.32.

Fault tolerance technical details

Fault tolerance in Feldera means that if a pipeline compute node fails and restarts, then the pipeline resumes gracefully, without dropping or duplicating input or output. Previously, we showed how fault tolerance works from a user point of view. In this blog post, we delve into some of the technical details of fault tolerance.

Correctness at Feldera

In this blog post, we briefly describe our efforts and development processes that ensure Feldera's engine is correct.

Recursive SQL queries in Feldera

The standard SQL definition for recursion is hard to use and limited in expressivity. Feldera SQL introduces an alternative, more powerful syntax that simplifies recursive computations, enabling mutually recursive views, richer queries, and non-monotone logic without relying on common-table expressions.

Incremental Update 11

Recursive SQL and a new UI design! A quick overview of what's new in v0.31.

Fault tolerance now in preview!

Fault tolerance is now in preview for our enterprise offering! This lets Feldera pipelines survive crashes and machine failures, and resume exactly from where they left off using network-attached or remote storage.

Inspecting Feldera pipelines

We have recently announced the ability of using ad-hoc queries to interact with Feldera pipelines. In this blog post we describe how this feature is implemented.

Incremental Update 10

ROW type! A quick overview of what's new in v0.30.