Merge ~cjwatson/launchpad:db-kafka-offset into launchpad:db-devel
Proposed by
Colin Watson
| Status: | Needs review |
|---|---|
| Proposed branch: | ~cjwatson/launchpad:db-kafka-offset |
| Merge into: | launchpad:db-devel |
| Diff against target: |
22 lines (+16/-0) 1 file modified
database/schema/patch-2211-18-0.sql (+16/-0) |
| Related bugs: |
| Reviewer | Review Type | Date Requested | Status |
|---|---|---|---|
| Ines Almeida | Approve | ||
| William Grant | db | Pending | |
| Launchpad code reviewers | db | Pending | |
|
Review via email:
|
|||
Commit message
Add KafkaOffset table
Description of the change
In order to consume events from Kafka, we'll need a way to keep track of our position in any given event stream. This is tracked by topic name and partition (with the number of partitions depending on the number of parallel consumers of any given topic). Updating a table of (topic, partition, offset) in the same transaction as we handle whatever else we need to do for that event gives us exactly-once event delivery, and seems to integrate quite nicely into the rest of Launchpad.
To post a comment you must log in.
There was an error fetching revisions from git servers. Please try again in a few minutes. If the problem persists, contact Launchpad support.
Preview Diff
[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
LGTM