apache storm - How to do Fields Grouping in Kafka Spout (JAVA)? -
- i've requirement consume delta updates of items kafka queue partitions.
- producer makes sure delta updates corresponding given item available in same partition , in order. ex: i1 & i2 items, there updates i1-up1, i1-up2 in same partition.similarly, i2-up1 & i2-up2 in same partition. 
- hence, when first set of bolts receive should fields grouped based on items( i1 , i2). mean, same bolt should receive updates of i1 in order. 
- the problem how can specify in bolt right after spout kafkaspout needs something. 
- a quick search said can write own kafka scheme(implement multischeme), lacks code examples. i've written 1 not sure how make sure fields grouping. 
 
 
  
Comments
Post a Comment