1.Create main and sub transformation as discussed below
2.call sub transformation from main Transformation

Note:-Sub transformation required for Kafka consumer step

Download working sample from here
https://drive.google.com/open?id=1Z4C2miczU0BnB4n3r1LcpN78v2UjefWQ

In the kaka transformation,

1.We are using direct bootstrap server on connection.

2. we added the consumer group "test-consumer-group1" change consumer group after every run to retrieve Kafka message from start.

Important:-if you not change consumer group, kafka will not retrieve any message unless any new message arrived to topic.

like test-consumer-group1,test-consumer-group2,test-consumer-group3 .....

3. Changed the auto.offset.reset to "earliest" on options tab.

In the sub transformation.

In "Get records from stream" step, we gave the below fields Fieldname Type key None
message None
topic None
partition None
offset None
timestamp Timestamp