apache storm - How to do Fields Grouping in Kafka Spout (JAVA)? -
- i've requirement consume delta updates of items kafka queue partitions.
producer makes sure delta updates corresponding given item available in same partition , in order. ex: i1 & i2 items, there updates i1-up1, i1-up2 in same partition.similarly, i2-up1 & i2-up2 in same partition.
hence, when first set of bolts receive should fields grouped based on items( i1 , i2). mean, same bolt should receive updates of i1 in order.
the problem how can specify in bolt right after spout kafkaspout needs something.
a quick search said can write own kafka scheme(implement multischeme), lacks code examples. i've written 1 not sure how make sure fields grouping.
Comments
Post a Comment