How and why and what for do tombstone records appear in Kafka?

Studying kafka, came across issues deletes tombstone messages ( e.g. while log compaction)

But my question is: how do tombstones even appear there? Who and why wanna use it and for what?

1

Best Answer

They are written by the producing application (e.g. Producer API, or Kafka Connect source connector) by putting a null in the value part of the message. It denotes a logical deletion for the associated key in the message.If you use log compaction then in time the previous values for that key are actually deleted too.

More info: https://medium.com/@damienthomlutz/deleting-records-in-kafka-aka-tombstones-651114655a16

Random Posts

How to protect an HTML element within designmode=onHow to trigger XL Release task from Jenkins ? Is it possible?Using ifelse Within applyC++ on mac : linker command failed with exit code 1 (use -v to see invocation)Use value from other list in calculated column?'cupy.core.core.ndarray' object has no attribute 'unique'How to highlight search words in vim permanently?inserting characters at the start and end of a stringjquery function val() is not equivalent to "$(this).value="?Using str_sub from stringr to replace characters in all elements of a vectordict.items() in python dictionary return typeHow do I change the dropdown icon in material-ui select field?A difference between statement and decision coverageConvert 9-digit CUSIP codes into ISIN codesDifferent versions of Crystal Reports runtimeHow to install or upgrade in ansible all packages in a yum repositoryUnable to authenticate the login of application user using KeycloakUncaught syntaxerror: unexpected identifier? [closed]Uncaught TypeError: Cannot read property 'split' of undefinedhow to make class decorated using dataclasses to throw error if different field types are assigned?